-- Logs begin at Wed 2021-08-25 00:49:48 UTC, end at Wed 2021-08-25 01:45:04 UTC. -- Aug 25 01:14:38.697192 dv-cinder-790014-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 25 01:14:38.704500 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 25 01:14:38.706538 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 25 01:14:38 2021] *** Aug 25 01:14:38.706538 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 01:14:38.706538 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 01:14:38.706538 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: nodename: dv-cinder-790014-2-iscsi Aug 25 01:14:38.706538 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: machine: x86_64 Aug 25 01:14:38.706866 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: clock source: unix Aug 25 01:14:38.706866 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: pcre jit disabled Aug 25 01:14:38.706866 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: detected number of CPU cores: 4 Aug 25 01:14:38.706866 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: current working directory: / Aug 25 01:14:38.706866 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: detected binary path: /usr/bin/uwsgi-core Aug 25 01:14:38.706866 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: your processes number limit is 47680 Aug 25 01:14:38.706866 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: your memory page size is 4096 bytes Aug 25 01:14:38.706866 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: detected max file descriptor number: 2048 Aug 25 01:14:38.706866 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: lock engine: pthread robust mutexes Aug 25 01:14:38.709644 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: thunder lock: enabled Aug 25 01:14:38.709644 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 25 01:14:38.709644 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 25 01:14:38.754622 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: Python main interpreter initialized at 0x55d209c139c0 Aug 25 01:14:38.754622 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: python threads support enabled Aug 25 01:14:38.754622 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: your server socket listen backlog is limited to 100 connections Aug 25 01:14:38.754622 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: your mercy for graceful operations on workers is 90 seconds Aug 25 01:14:38.755018 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 01:14:38.755096 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: *** Operational MODE: preforking *** Aug 25 01:14:38.755345 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: *** uWSGI is running in multiple interpreter mode *** Aug 25 01:14:38.755345 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: spawned uWSGI master process (pid: 73320) Aug 25 01:14:38.755550 dv-cinder-790014-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 25 01:14:38.758752 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: spawned uWSGI worker 1 (pid: 73335, cores: 1) Aug 25 01:14:38.758752 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: spawned uWSGI worker 2 (pid: 73336, cores: 1) Aug 25 01:14:38.758752 dv-cinder-790014-2-iscsi devstack@keystone.service[73320]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 01:14:43.789305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:14:43.789305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: from cryptography.utils import int_from_bytes Aug 25 01:14:43.790052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:14:43.790052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: from cryptography.utils import int_from_bytes Aug 25 01:14:43.790168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:14:43.790168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: from cryptography.utils import int_from_bytes Aug 25 01:14:43.790589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:14:43.790589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: from cryptography.utils import int_from_bytes Aug 25 01:14:43.838371 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 01:14:43.838553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 01:14:43.838787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] command line args: [] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 01:14:43.839042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 01:14:43.839225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ================================================================================ {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 01:14:43.839433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 01:14:43.839530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] admin_token = **** {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.839667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 01:14:43.839757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] config_dir = [] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.839826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] command line args: [] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 01:14:43.839886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.840071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] config_source = [] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.840168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 01:14:43.840238 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] debug = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.840300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ================================================================================ {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 01:14:43.840484 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.842666 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] admin_token = **** {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.842666 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] config_dir = [] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.842932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] config_source = [] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] debug = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843308 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843462 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] list_limit = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] log_config_append = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843845 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] log_dir = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.843978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] log_file = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844043 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] list_limit = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] log_config_append = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] log_dir = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] log_file = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.844804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.845039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.845274 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.845506 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.845716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.845923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.846094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.846291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.846519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.846804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.847051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.847051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.847491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.847684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.847882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.848114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.848114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.848492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.848721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.848925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] publish_errors = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.849628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.849794 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.849991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.850186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.850186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.850479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.850652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.850822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.850997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.851144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.851276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] standard_threads = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.851276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.851532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.851701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.851952 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] publish_errors = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.852109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.852249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.852387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] use_journal = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.852387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] use_json = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.852635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.852774 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] use_stderr = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.852907 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.853086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] use_syslog = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.853262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.853395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.853526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.853665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.853804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] standard_threads = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.853942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.854080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.854212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.854348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.854491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.854629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.854629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] use_journal = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.854932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.855075 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] use_json = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.855217 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.855408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] use_stderr = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.855408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] use_syslog = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.855668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.855800 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:14:43.855931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.856062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.856201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.856335 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.856472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.856646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.856780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.856917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.857139 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.857273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.857407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.857539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.857669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.857806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.857945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.858077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.858214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.858347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.858484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.858617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.858795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.858947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.859085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.859222 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.859354 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.859486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.859628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.859767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.859898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.860028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.860159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.860297 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.860430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.860571 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.860713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.860850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.860987 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.861131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.861269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.861269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.861518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.861648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.861648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.861908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.862040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.862040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.862293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.862425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.862425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.862789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.862955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.862955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.863205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.863343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.863343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.863669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.863804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.863804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.864050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.864180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.864311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.864460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.864460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.864709 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.865441 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.865441 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.865705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.865846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.865846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.866093 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.866290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.866290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.866545 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.866747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.866747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.867017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.867149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.867280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.867411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.867551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.867683 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.867815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.867946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.868077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.868208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.868347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.868479 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.868610 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.869819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.869996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.870230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.870443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.870647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.870866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.871064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.871260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.871498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.871730 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.871938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.872148 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.872318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.872548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.872763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.872976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.873145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.873375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.873547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.873745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.873942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.874178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.874348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.874545 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.874791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.874962 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.875140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.875326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.875515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.875654 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.875825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.875963 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.876097 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.876229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.876369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.876540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.876673 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.876806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.876938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.877076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.877217 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.877369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.877503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.877643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.877806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.877944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.878084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.878218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.878351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.878483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.878624 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.878806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.878952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.879085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.879227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.879361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.879493 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.879624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.879875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.880028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.880164 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.880305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.880473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.880647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.880855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.880991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.881124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.881256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.881256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.881516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.881657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.881791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.881923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.882055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] auth.external = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.882187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.882319 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.882460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.882595 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.882747 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.882885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.883017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.883160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] auth.password = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.883304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.883439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] auth.token = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.883580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.883722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.883855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.883988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.884120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.884260 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.884393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.884526 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.884659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.884791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.884923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.885078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.885212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.885351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.885484 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.885617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] credential.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.885757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.885900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.886035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.886166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.886298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.886430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.886562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.886724 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.886881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.887023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.887157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] auth.external = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.887290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.887422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.887563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.887961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.888096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.888228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.888359 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.888518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] auth.password = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.888660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.888795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] auth.token = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.888935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.889079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.889218 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.889352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.889352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.889610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.889752 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.889888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.890027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.890161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.890304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.890444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] federation.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.890593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.890771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.890921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] credential.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.891127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.891279 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.891417 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.891562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.891697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.891836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.891970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.892104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.892236 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.892380 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.892515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.892649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.892781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.892924 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.893066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.893208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.893342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.893475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.893608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.893741 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.893882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.894017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.894155 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.894155 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.894406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.894539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.894539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.894834 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.894968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.895103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.895235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.895379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.895521 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.895655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] federation.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.895794 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.895933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.896067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.896207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.896348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.896482 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.896625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.896758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.896891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.897030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.897239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.897375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.897521 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.897655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.897789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.897929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.898071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.898208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.898343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.898487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.898487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.898773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.898921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.899062 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.899196 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.899330 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.899463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.899596 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.899737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.899871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.900004 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.900137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.900277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.900428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.900580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.900716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.900849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.900981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.901114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.901247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.901389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.901524 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.901657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.901791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.901924 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.902056 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.902197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.902344 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.902479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.902619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.902776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.902911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.903058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.903198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.903333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.903468 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.903600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.903742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.903877 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.904011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.904159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.904292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.904431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.904574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.904708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.904842 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.904976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.905116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.905250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.905391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.905528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.905662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.905796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.905935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.906078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.906220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.906354 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.906488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.906622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.906816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.906951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.907101 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.907243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.907378 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.907512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.907647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.907780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.907935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.908070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.908204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.908336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.908470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.908603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.908753 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.908894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.909035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.909175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.909315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.909461 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.909610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.909753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.909903 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.910044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.910183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.910323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.910482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.910625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.910850 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.910996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.911137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.911277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.911428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.911570 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.912200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.912347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.912498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.912638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.912823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.912970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.913111 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.913251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.913390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.913531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.913679 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.913820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.913820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.914085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.914085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.914359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.914508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.914649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.914842 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.914984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.915124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.915264 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.915416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.915557 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.915697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.915836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.915836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.916100 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.916247 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.916399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.916539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.916684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.916824 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.916964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.917112 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.917254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.917393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.917533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.917678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.917819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.917967 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.918109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.918249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.918399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.918538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.918755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.918915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.919057 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.919198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.919338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] resource.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.919564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.919740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.919892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.920035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.920175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.920321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.920493 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.920639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.920789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.920930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.921070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.921210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.921351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.921492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.921640 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.921783 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.921923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.922064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.922203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.922345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] role.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.922504 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.922646 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] role.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.922825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.922968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.923109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.923261 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.923404 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.923545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.923685 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.923825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.923965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.924113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.924255 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.924395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.924546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] resource.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.924686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.924825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.925040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.925184 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.925325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.925466 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.925606 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.925746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.925895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.926036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.926176 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.926317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.926467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.926609 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.926782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.926925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.926925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.927190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.927942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] role.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.928086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.928235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] role.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.928376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.928522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.928664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.928804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.928945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.929107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.929251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.929391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.929532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.929673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.929813 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.929961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.930102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.930243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.930390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.930534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.930691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.930853 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.931006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.931146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.931286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.931426 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.931567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.931715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.931858 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.931997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.932138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.932277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.932426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.932568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.932708 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.932860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.933001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.933141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.933291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] token.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.933432 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.933572 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.933712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.933854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.933994 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.934142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.934283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.934423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.934563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.934762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.934911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.935064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.935206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.935346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.935486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.935627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.935767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.935916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.936058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.936199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.936339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.936480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.936620 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.936777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.936919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.937060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.937200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.937341 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.937480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.937628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.937769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.937909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.938050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] token.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.938190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.938330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.938478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.connection = **** {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.938620 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.938794 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.938936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.939076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.939218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.939370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.939512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.939652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.939792 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.939932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.940072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.940221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.940372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.940512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.940662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.940803 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.940943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.941096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.941239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.941379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.941519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.941658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.941806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.941956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.942105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.942105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.942373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.942513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.942663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.942663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.943005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.943184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.943326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.connection = **** {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.943466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.943607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.943747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.943896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.944037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 01:14:43.944223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.944223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.944223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.944223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.944223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.944223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.944223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.944223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.944223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.945582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.945582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.945582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.945582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.945582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.945582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.945582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:14:43.945582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 01:14:43.954559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.954837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.955073 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.956918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.957153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.957379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.964154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.966237 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.992959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.993195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.994843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:43.995085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.048294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.048558 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.097584 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.097831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.098033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.098277 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.165850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.166072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.166163 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.166294 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.166404 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.166581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.166668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.166830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.166917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.167048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.167134 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.167324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.276200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.276534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.276653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.276730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.276794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.276856 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.276917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.277243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.277330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.277395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.277457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.277518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.277588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.277915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.289371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.289769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.302131 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.302360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.302480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.302550 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.302786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.302875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.302940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.303016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.303275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.303369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.303436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.303498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.303568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.303843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 01:14:44.320973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.321190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 01:14:44.321529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.321617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.321824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 01:14:44.321911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 01:14:44.322078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.322162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.322326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.322419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 01:14:44.322589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.322766 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.322855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.322920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.323120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.323350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.333446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.334257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.334418 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.334518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.334738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.334828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.334998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.335254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.343029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.343809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.346250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.346533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.346841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.347038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.347127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.347312 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.347398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.347586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.347675 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.347863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.347961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.348145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.348231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.348397 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.348481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.348657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.348742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.348911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.348994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.349203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.349476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.349740 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.376153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.376872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.377745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.378026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.378455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.378754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.383927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.384210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.384494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.384658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.384866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.385144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.391947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.392230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.392867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.393154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.397176 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.397462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.397743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.398024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.398187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.398358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.398513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.398663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.398839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.398997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.399148 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.399291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.399441 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.399441 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.399725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.399944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.417521 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.417799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.418256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.418531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.422339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.423053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.426065 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.426363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.426752 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.427047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.431404 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.432106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.434949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.435653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.438542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.438862 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.439156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.439315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.439466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.439630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.439782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.439932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.440083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.440234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.440393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.440575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.460039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.460325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.460484 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.460659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.460804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.460947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.461095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.461244 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.468614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.468965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.470402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.470706 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.470870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.471015 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.473713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.473994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.474152 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.474303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.474454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.474613 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.474811 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.474964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.475115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.475266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.489531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.489787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.490016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.490175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.490330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.490489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.490698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.490881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.491036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.491196 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.491342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.491496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.491650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.491650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.510377 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.513890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.514622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.517331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.517851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.518941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.520542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.520820 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.521681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.521849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.523428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.525016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.525289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.525589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.528906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.530496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.532726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.534219 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.534316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.534507 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.534820 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.535110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.538611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.538923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.539204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.539477 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.544297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.544588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.544869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.548456 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.548744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.549023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.552836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.553067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.553347 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.553632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.553915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.554189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.554472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.554790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.555067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.555340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.555617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.555897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.556173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.556444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.556898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 01:14:44.557175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.557452 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.557735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.558020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.558291 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.558568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.558856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.559123 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.559389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.559663 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.559935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.560215 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.560474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 01:14:44.594923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d209c139c0 pid: 73335 (default app) Aug 25 01:14:44.598170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af34bd-aa90-45a7-bc22-59424049e30a None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:44.598472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af34bd-aa90-45a7-bc22-59424049e30a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:44.598773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af34bd-aa90-45a7-bc22-59424049e30a None None] PATH_INFO: `/v3` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:44.599006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d209c139c0 pid: 73336 (default app) Aug 25 01:14:44.602945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 792 bytes} [Wed Aug 25 01:14:44 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:14:52.080396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4cb37-a398-4b05-8c77-253bc48b0d1e None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:52.080919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4cb37-a398-4b05-8c77-253bc48b0d1e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:52.081022 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4cb37-a398-4b05-8c77-253bc48b0d1e None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:52.086564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:14:52 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:14:52.092353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7711fc-b4d9-4c08-877d-fe68ad3cc26c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:52.092762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7711fc-b4d9-4c08-877d-fe68ad3cc26c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:52.092908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7711fc-b4d9-4c08-877d-fe68ad3cc26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:52.122737 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG oslo_db.sqlalchemy.engines [None req-5d7711fc-b4d9-4c08-877d-fe68ad3cc26c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:14:52.306349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG passlib.handlers.bcrypt [None req-5d7711fc-b4d9-4c08-877d-fe68ad3cc26c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73335) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 25 01:14:52.306785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG passlib.handlers.bcrypt [None req-5d7711fc-b4d9-4c08-877d-fe68ad3cc26c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73335) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 25 01:14:52.360669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-5d7711fc-b4d9-4c08-877d-fe68ad3cc26c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:14:52.362193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5d7711fc-b4d9-4c08-877d-fe68ad3cc26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:14:52.503412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:14:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:14:52.652588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4cb37-a398-4b05-8c77-253bc48b0d1e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:52.686612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG oslo_db.sqlalchemy.engines [None req-96e4cb37-a398-4b05-8c77-253bc48b0d1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:14:52.814912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4cb37-a398-4b05-8c77-253bc48b0d1e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:52.819208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924e2b9-c763-4b63-965b-5667602737c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:52.819866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924e2b9-c763-4b63-965b-5667602737c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:52.820155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924e2b9-c763-4b63-965b-5667602737c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:52.820434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924e2b9-c763-4b63-965b-5667602737c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:52.828292 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924e2b9-c763-4b63-965b-5667602737c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:14:52.878662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8924e2b9-c763-4b63-965b-5667602737c2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 25 01:14:52.879028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924e2b9-c763-4b63-965b-5667602737c2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:14:52.888626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:14:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:14:52.895437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7711fc-b4d9-4c08-877d-fe68ad3cc26c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:52.909338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7711fc-b4d9-4c08-877d-fe68ad3cc26c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:52.914319 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d059f-353c-42e5-8484-1ed57d87f775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:52.915450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d059f-353c-42e5-8484-1ed57d87f775 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:52.915741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d059f-353c-42e5-8484-1ed57d87f775 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:52.916017 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d059f-353c-42e5-8484-1ed57d87f775 admin admin] PATH_INFO: `/v3/projects/220c843aa1514b7390df45e1ecd50d12` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:52.917533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d059f-353c-42e5-8484-1ed57d87f775 admin admin] RBAC: Authorizing `identity:get_project(project_id=220c843aa1514b7390df45e1ecd50d12)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:14:52.969827 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0e8d059f-353c-42e5-8484-1ed57d87f775 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 25 01:14:52.970171 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d059f-353c-42e5-8484-1ed57d87f775 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:14:52.975366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:14:52 2021] GET /identity/v3/projects/220c843aa1514b7390df45e1ecd50d12 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:14:55.099092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dcbc6-dc81-429d-94bb-87e77834a7fd None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:55.099711 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dcbc6-dc81-429d-94bb-87e77834a7fd None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:55.099711 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dcbc6-dc81-429d-94bb-87e77834a7fd None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:55.104136 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:14:55 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:14:55.110100 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c645e3-6616-4c47-8b6d-9a36918d3a29 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:55.110463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c645e3-6616-4c47-8b6d-9a36918d3a29 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:55.110655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c645e3-6616-4c47-8b6d-9a36918d3a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:55.128741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-10c645e3-6616-4c47-8b6d-9a36918d3a29 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:14:55.130742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-10c645e3-6616-4c47-8b6d-9a36918d3a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:14:55.138571 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:14:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:14:55.161944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dcbc6-dc81-429d-94bb-87e77834a7fd None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:55.173689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dcbc6-dc81-429d-94bb-87e77834a7fd None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:55.177886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc549d-8a97-445e-9530-f61840606a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:55.178508 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc549d-8a97-445e-9530-f61840606a1b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:55.178832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc549d-8a97-445e-9530-f61840606a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:55.179110 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc549d-8a97-445e-9530-f61840606a1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:55.186531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc549d-8a97-445e-9530-f61840606a1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:14:55.188338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc549d-8a97-445e-9530-f61840606a1b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:14:55.197306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:14:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:14:55.203039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c645e3-6616-4c47-8b6d-9a36918d3a29 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:55.212286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c645e3-6616-4c47-8b6d-9a36918d3a29 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:55.216546 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96690668-f34c-4ce1-862b-22a7200ad80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:55.217392 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96690668-f34c-4ce1-862b-22a7200ad80c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:55.217665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96690668-f34c-4ce1-862b-22a7200ad80c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:55.217937 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96690668-f34c-4ce1-862b-22a7200ad80c admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:55.219352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96690668-f34c-4ce1-862b-22a7200ad80c admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:14:55.221157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96690668-f34c-4ce1-862b-22a7200ad80c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:14:55.222657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:14:55 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:14:57.384218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d93b5a-c0f1-48df-b6e3-47f489b105e8 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.384738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d93b5a-c0f1-48df-b6e3-47f489b105e8 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.384946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d93b5a-c0f1-48df-b6e3-47f489b105e8 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.386514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:14:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:14:57.392572 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f000c1-0a63-4ef3-bf4a-3dcadc4592f9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.392985 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f000c1-0a63-4ef3-bf4a-3dcadc4592f9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.393245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f000c1-0a63-4ef3-bf4a-3dcadc4592f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.410359 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-19f000c1-0a63-4ef3-bf4a-3dcadc4592f9 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:14:57.412102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-19f000c1-0a63-4ef3-bf4a-3dcadc4592f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:14:57.419468 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:14:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:14:57.422577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53b3d2-59a5-4e17-8cb9-a569a0b57fcb None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.422900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53b3d2-59a5-4e17-8cb9-a569a0b57fcb None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.423180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53b3d2-59a5-4e17-8cb9-a569a0b57fcb None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.424882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 6/12] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:14:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:14:57.431168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1767d7f-11e9-4be2-9f35-d68dc43ef07c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.431457 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1767d7f-11e9-4be2-9f35-d68dc43ef07c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.431731 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1767d7f-11e9-4be2-9f35-d68dc43ef07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.443508 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53b3d2-59a5-4e17-8cb9-a569a0b57fcb None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:57.448486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c1767d7f-11e9-4be2-9f35-d68dc43ef07c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:14:57.449660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c1767d7f-11e9-4be2-9f35-d68dc43ef07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:14:57.455086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53b3d2-59a5-4e17-8cb9-a569a0b57fcb None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:57.456997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:14:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:14:57.459928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8228b-d719-4580-a190-74a616e839fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:57.460689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8228b-d719-4580-a190-74a616e839fd admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.460973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8228b-d719-4580-a190-74a616e839fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.461253 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8228b-d719-4580-a190-74a616e839fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.477863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8228b-d719-4580-a190-74a616e839fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:14:57.480509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1767d7f-11e9-4be2-9f35-d68dc43ef07c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:57.484710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-91b8228b-d719-4580-a190-74a616e839fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:14:57.486055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:14:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:14:57.489411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1767d7f-11e9-4be2-9f35-d68dc43ef07c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:57.492512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8228b-d719-4580-a190-74a616e839fd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:57.493910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdc04c-4d5b-4710-a059-a2030d3dd51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:57.494550 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc04c-4d5b-4710-a059-a2030d3dd51b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.494867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc04c-4d5b-4710-a059-a2030d3dd51b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.495150 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc04c-4d5b-4710-a059-a2030d3dd51b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.502359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8228b-d719-4580-a190-74a616e839fd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:57.503048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdc04c-4d5b-4710-a059-a2030d3dd51b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:14:57.504838 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdc04c-4d5b-4710-a059-a2030d3dd51b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:14:57.506861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56437f-cd12-4373-a616-9d77f7dae26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:57.507776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56437f-cd12-4373-a616-9d77f7dae26c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.507776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56437f-cd12-4373-a616-9d77f7dae26c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.508044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56437f-cd12-4373-a616-9d77f7dae26c admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.508795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56437f-cd12-4373-a616-9d77f7dae26c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:14:57.509105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56437f-cd12-4373-a616-9d77f7dae26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:14:57.510852 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-4a56437f-cd12-4373-a616-9d77f7dae26c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:14:57.510852 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:14:57.510852 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:14:57.511780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56437f-cd12-4373-a616-9d77f7dae26c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:14:57.514005 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:14:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:14:57.519941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdc04c-4d5b-4710-a059-a2030d3dd51b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:57.527309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:14:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:14:57.528616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdc04c-4d5b-4710-a059-a2030d3dd51b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:57.532924 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861797fd-b0ec-4302-90ff-cdd4d86b8cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:57.533683 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861797fd-b0ec-4302-90ff-cdd4d86b8cca admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.533962 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861797fd-b0ec-4302-90ff-cdd4d86b8cca admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.534232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861797fd-b0ec-4302-90ff-cdd4d86b8cca admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.535412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861797fd-b0ec-4302-90ff-cdd4d86b8cca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:14:57.537665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861797fd-b0ec-4302-90ff-cdd4d86b8cca admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:14:57.538380 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56437f-cd12-4373-a616-9d77f7dae26c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:57.539205 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:14:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:14:57.557556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56437f-cd12-4373-a616-9d77f7dae26c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:57.564071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67883c96-0931-4405-a02e-c916814f0615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:57.564957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883c96-0931-4405-a02e-c916814f0615 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.565240 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883c96-0931-4405-a02e-c916814f0615 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.565515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883c96-0931-4405-a02e-c916814f0615 admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.567353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67883c96-0931-4405-a02e-c916814f0615 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:14:57.569221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67883c96-0931-4405-a02e-c916814f0615 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:14:57.571071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:14:57 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:14:57.577763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861797fd-b0ec-4302-90ff-cdd4d86b8cca admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:57.588240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861797fd-b0ec-4302-90ff-cdd4d86b8cca admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:57.592852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c0e26-a0b2-43d8-8e24-6144c3747879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:57.593664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0e26-a0b2-43d8-8e24-6144c3747879 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.593945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0e26-a0b2-43d8-8e24-6144c3747879 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.594216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c0e26-a0b2-43d8-8e24-6144c3747879 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.595481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c0e26-a0b2-43d8-8e24-6144c3747879 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:14:57.597271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c0e26-a0b2-43d8-8e24-6144c3747879 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:14:57.599601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:14:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:14:57.606245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67883c96-0931-4405-a02e-c916814f0615 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:14:57.616216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67883c96-0931-4405-a02e-c916814f0615 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:14:57.620642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b8a7-7a9e-4c49-b640-8a2a62b5e4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:14:57.621299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b8a7-7a9e-4c49-b640-8a2a62b5e4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:14:57.621581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b8a7-7a9e-4c49-b640-8a2a62b5e4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:14:57.621857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b8a7-7a9e-4c49-b640-8a2a62b5e4a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:14:57.623009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b8a7-7a9e-4c49-b640-8a2a62b5e4a5 admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.domain.id=default, user.id=3c48fa6914a840d99c4665f7fb9f25b2) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:14:57.623329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b8a7-7a9e-4c49-b640-8a2a62b5e4a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:14:57.624348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-7d85b8a7-7a9e-4c49-b640-8a2a62b5e4a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:14:57.624348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:14:57.624348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:14:57.625544 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b8a7-7a9e-4c49-b640-8a2a62b5e4a5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:14:57.635206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1344 bytes} [Wed Aug 25 01:14:57 2021] GET /identity/v3/role_assignments?user.id=3c48fa6914a840d99c4665f7fb9f25b2&scope.domain.id=default&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:00.193810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc34b1-c1b6-4ede-baec-75b7b2aa28e5 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.194325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc34b1-c1b6-4ede-baec-75b7b2aa28e5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.194400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc34b1-c1b6-4ede-baec-75b7b2aa28e5 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.196731 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:00.203053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16641640-618d-45fd-b99f-f5328baf9595 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.203487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16641640-618d-45fd-b99f-f5328baf9595 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.203657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16641640-618d-45fd-b99f-f5328baf9595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.249886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG passlib.handlers.bcrypt [None req-16641640-618d-45fd-b99f-f5328baf9595 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73336) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 25 01:15:00.250637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG passlib.handlers.bcrypt [None req-16641640-618d-45fd-b99f-f5328baf9595 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73336) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 25 01:15:00.294961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a9b1-a3e2-4c19-9ced-d9fa7caab2ab None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.295615 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a9b1-a3e2-4c19-9ced-d9fa7caab2ab None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.296109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9a9b1-a3e2-4c19-9ced-d9fa7caab2ab None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.297479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-16641640-618d-45fd-b99f-f5328baf9595 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:00.299616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-16641640-618d-45fd-b99f-f5328baf9595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:00.299889 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:00.305687 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8a0b5-db0e-4717-8ed5-02946a166af1 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.306235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8a0b5-db0e-4717-8ed5-02946a166af1 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.306754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8a0b5-db0e-4717-8ed5-02946a166af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.325172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-53e8a0b5-db0e-4717-8ed5-02946a166af1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:00.326662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-53e8a0b5-db0e-4717-8ed5-02946a166af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:00.339255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 13/23] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:00.352229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 11/24] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:00.380215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8a0b5-db0e-4717-8ed5-02946a166af1 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:00.390193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8a0b5-db0e-4717-8ed5-02946a166af1 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:00.392876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16641640-618d-45fd-b99f-f5328baf9595 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:00.395398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df891fb0-8d96-4c2b-a2cf-430fe9d5e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:00.396474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df891fb0-8d96-4c2b-a2cf-430fe9d5e0af admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.396954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df891fb0-8d96-4c2b-a2cf-430fe9d5e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.397420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df891fb0-8d96-4c2b-a2cf-430fe9d5e0af admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.409547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16641640-618d-45fd-b99f-f5328baf9595 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:00.412360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df891fb0-8d96-4c2b-a2cf-430fe9d5e0af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:00.420249 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-df891fb0-8d96-4c2b-a2cf-430fe9d5e0af admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:00.426877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 14/25] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:00.428636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd8410-df75-42f6-b863-b1f9d45a1bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:00.429334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df891fb0-8d96-4c2b-a2cf-430fe9d5e0af admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:00.429965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd8410-df75-42f6-b863-b1f9d45a1bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.430262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd8410-df75-42f6-b863-b1f9d45a1bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.430538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd8410-df75-42f6-b863-b1f9d45a1bc9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.440391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df891fb0-8d96-4c2b-a2cf-430fe9d5e0af admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:00.445181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c4400-7118-4380-918d-efe1ea2070f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:00.446079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4400-7118-4380-918d-efe1ea2070f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.446554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4400-7118-4380-918d-efe1ea2070f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.447046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c4400-7118-4380-918d-efe1ea2070f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.447980 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c4400-7118-4380-918d-efe1ea2070f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:00.448474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c4400-7118-4380-918d-efe1ea2070f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:00.450434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-531c4400-7118-4380-918d-efe1ea2070f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:00.450434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:00.450434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:00.451957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c4400-7118-4380-918d-efe1ea2070f1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:00.464512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd8410-df75-42f6-b863-b1f9d45a1bc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:00.466448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd8410-df75-42f6-b863-b1f9d45a1bc9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:00.471152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 15/26] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:00.473267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c4400-7118-4380-918d-efe1ea2070f1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:00.483723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c4400-7118-4380-918d-efe1ea2070f1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:00.494408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bb709-b68d-46b3-87df-0d092c65d769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:00.495596 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bb709-b68d-46b3-87df-0d092c65d769 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.496165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bb709-b68d-46b3-87df-0d092c65d769 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.496639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bb709-b68d-46b3-87df-0d092c65d769 admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.498035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bb709-b68d-46b3-87df-0d092c65d769 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:00.500077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bb709-b68d-46b3-87df-0d092c65d769 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:00.501874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 16/27] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:00 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:00.508749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bb709-b68d-46b3-87df-0d092c65d769 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:00.511497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-8cbd8410-df75-42f6-b863-b1f9d45a1bc9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:00.513503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 12/28] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:00.519395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd8410-df75-42f6-b863-b1f9d45a1bc9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:00.524712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bb709-b68d-46b3-87df-0d092c65d769 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:00.529504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4f8e-113c-4759-b391-a2c9045a6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:00.530509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4f8e-113c-4759-b391-a2c9045a6474 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.531014 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4f8e-113c-4759-b391-a2c9045a6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.531476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4f8e-113c-4759-b391-a2c9045a6474 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.532717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd8410-df75-42f6-b863-b1f9d45a1bc9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:00.533069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff4f8e-113c-4759-b391-a2c9045a6474 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:00.539154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff4f8e-113c-4759-b391-a2c9045a6474 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:00.541366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 17/29] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:00.546980 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4f8e-113c-4759-b391-a2c9045a6474 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:00.552345 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904c1da-2dd8-4d3d-9bc9-ce12d5411f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:00.553275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904c1da-2dd8-4d3d-9bc9-ce12d5411f68 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.553767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904c1da-2dd8-4d3d-9bc9-ce12d5411f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.554249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904c1da-2dd8-4d3d-9bc9-ce12d5411f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.555298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904c1da-2dd8-4d3d-9bc9-ce12d5411f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:00.555831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904c1da-2dd8-4d3d-9bc9-ce12d5411f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:00.557037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-8904c1da-2dd8-4d3d-9bc9-ce12d5411f68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:00.557037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:00.557037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:00.558624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904c1da-2dd8-4d3d-9bc9-ce12d5411f68 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:00.560852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4f8e-113c-4759-b391-a2c9045a6474 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:00.570699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cf7ed-9caa-4f3c-8000-def5557c6f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:00.570699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cf7ed-9caa-4f3c-8000-def5557c6f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.570699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cf7ed-9caa-4f3c-8000-def5557c6f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.570699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cf7ed-9caa-4f3c-8000-def5557c6f30 admin admin] PATH_INFO: `/v3/domains/default/users/3c48fa6914a840d99c4665f7fb9f25b2/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.571016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cf7ed-9caa-4f3c-8000-def5557c6f30 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3c48fa6914a840d99c4665f7fb9f25b2, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:00.571016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-897cf7ed-9caa-4f3c-8000-def5557c6f30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:00.571016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:00.571016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:00.579995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cf7ed-9caa-4f3c-8000-def5557c6f30 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:00.590478 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 13/30] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:00.596773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904c1da-2dd8-4d3d-9bc9-ce12d5411f68 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:00.611649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904c1da-2dd8-4d3d-9bc9-ce12d5411f68 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:00.725040 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a0894-1684-4252-960b-3a784d76141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:00.725635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a0894-1684-4252-960b-3a784d76141e admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.725922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a0894-1684-4252-960b-3a784d76141e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.726199 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a0894-1684-4252-960b-3a784d76141e admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.727158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a0894-1684-4252-960b-3a784d76141e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:00.728162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-cd0a0894-1684-4252-960b-3a784d76141e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:00.728162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:00.728162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:00.729409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a0894-1684-4252-960b-3a784d76141e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:00.828158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 18/31] 10.222.0.23 () {58 vars in 1383 bytes} [Wed Aug 25 01:15:00 2021] PUT /identity/v3/domains/default/users/3c48fa6914a840d99c4665f7fb9f25b2/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:15:00.830147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5a77-7f3e-4a88-b900-d27f7a17596a None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.830447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5a77-7f3e-4a88-b900-d27f7a17596a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.830752 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5a77-7f3e-4a88-b900-d27f7a17596a None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.836854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 19/32] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:00 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:00.848322 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef3450-8db3-42a1-9472-bd32d2cf44cf None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.848638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef3450-8db3-42a1-9472-bd32d2cf44cf None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.848990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef3450-8db3-42a1-9472-bd32d2cf44cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.882310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e7ef3450-8db3-42a1-9472-bd32d2cf44cf None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:00.883896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e7ef3450-8db3-42a1-9472-bd32d2cf44cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:00.898426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 20/33] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:00.933867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef3450-8db3-42a1-9472-bd32d2cf44cf None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:00.948470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef3450-8db3-42a1-9472-bd32d2cf44cf None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:00.953095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ed26-4d1f-48cc-acca-a468ef75bdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:00.953791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ed26-4d1f-48cc-acca-a468ef75bdb4 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.954076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ed26-4d1f-48cc-acca-a468ef75bdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.954357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ed26-4d1f-48cc-acca-a468ef75bdb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.955163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6ed26-4d1f-48cc-acca-a468ef75bdb4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:00.962500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-27b6ed26-4d1f-48cc-acca-a468ef75bdb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:00.962500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:00.962500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:00.963484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6ed26-4d1f-48cc-acca-a468ef75bdb4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:00.993619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 21/34] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:15:00 2021] POST /identity/v3/roles => generated 225 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:15:00.995088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021c60b-dc8e-44b4-9bc7-87798af1d760 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:00.995386 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021c60b-dc8e-44b4-9bc7-87798af1d760 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:00.995668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021c60b-dc8e-44b4-9bc7-87798af1d760 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:00.997467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 22/35] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:01.004256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2c2ea-0929-4ded-acc7-f3685e592945 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:01.004690 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2c2ea-0929-4ded-acc7-f3685e592945 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:01.004979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2c2ea-0929-4ded-acc7-f3685e592945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:01.017336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 14/36] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:15:00 2021] POST /identity/v3/projects => generated 301 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:15:01.026884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-90b2c2ea-0929-4ded-acc7-f3685e592945 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:01.028115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-90b2c2ea-0929-4ded-acc7-f3685e592945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:01.094896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 23/37] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:01.132024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a0894-1684-4252-960b-3a784d76141e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:01.149259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a0894-1684-4252-960b-3a784d76141e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:01.158142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158f280-18a4-4e72-98f9-8c321dde9836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:01.158928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f280-18a4-4e72-98f9-8c321dde9836 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:01.159223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f280-18a4-4e72-98f9-8c321dde9836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:01.159560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f280-18a4-4e72-98f9-8c321dde9836 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:01.160406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158f280-18a4-4e72-98f9-8c321dde9836 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:01.161701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-b158f280-18a4-4e72-98f9-8c321dde9836 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:01.161701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:01.161701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:01.162785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158f280-18a4-4e72-98f9-8c321dde9836 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:01.189611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 15/38] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:15:01 2021] POST /identity/v3/roles => generated 219 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:01.374799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd2a3-692b-4429-a29f-85947869a1c2 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:01.375500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd2a3-692b-4429-a29f-85947869a1c2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:01.375500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd2a3-692b-4429-a29f-85947869a1c2 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:01.377064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 24/39] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:01.384413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67db7f6-01f5-462b-9a48-50ae311a3f18 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:01.384906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67db7f6-01f5-462b-9a48-50ae311a3f18 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:01.385174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67db7f6-01f5-462b-9a48-50ae311a3f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:01.410269 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d67db7f6-01f5-462b-9a48-50ae311a3f18 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:01.411469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d67db7f6-01f5-462b-9a48-50ae311a3f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:01.420726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 16/40] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:01.451486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cd2a3-692b-4429-a29f-85947869a1c2 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:01.469440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cd2a3-692b-4429-a29f-85947869a1c2 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:01.475952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075536f-9bf3-4be3-a7d1-b611ec407af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:01.476639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075536f-9bf3-4be3-a7d1-b611ec407af6 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:01.476929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075536f-9bf3-4be3-a7d1-b611ec407af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:01.477215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075536f-9bf3-4be3-a7d1-b611ec407af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:01.477981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075536f-9bf3-4be3-a7d1-b611ec407af6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:01.479705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075536f-9bf3-4be3-a7d1-b611ec407af6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:01.502513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 25/41] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:15:01 2021] POST /identity/v3/roles => generated 223 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:01.825645 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9cc8-5787-4c51-a5e5-e87a3a416cec None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:01.826067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9cc8-5787-4c51-a5e5-e87a3a416cec None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:01.826352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9cc8-5787-4c51-a5e5-e87a3a416cec None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:01.828159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 17/42] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:01.834082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75e1d9-6aed-4e60-97ab-00ac5da443be None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:01.834377 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75e1d9-6aed-4e60-97ab-00ac5da443be None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:01.834659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75e1d9-6aed-4e60-97ab-00ac5da443be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:01.852295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-dc75e1d9-6aed-4e60-97ab-00ac5da443be None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:01.853470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-dc75e1d9-6aed-4e60-97ab-00ac5da443be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:01.860844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 26/43] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:01.885139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9cc8-5787-4c51-a5e5-e87a3a416cec None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:01.897255 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9cc8-5787-4c51-a5e5-e87a3a416cec None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:01.901402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feede26-cbf9-498f-b644-55a42c470df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:01.902179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feede26-cbf9-498f-b644-55a42c470df8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:01.902464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feede26-cbf9-498f-b644-55a42c470df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:01.902772 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feede26-cbf9-498f-b644-55a42c470df8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:01.903926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feede26-cbf9-498f-b644-55a42c470df8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:01.905601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feede26-cbf9-498f-b644-55a42c470df8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:01.907335 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 18/44] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:01.913505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75e1d9-6aed-4e60-97ab-00ac5da443be None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:01.922548 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75e1d9-6aed-4e60-97ab-00ac5da443be None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:01.927598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00c369-87a8-4a81-9018-a5b67e98f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:01.928254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00c369-87a8-4a81-9018-a5b67e98f902 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:01.928545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00c369-87a8-4a81-9018-a5b67e98f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:01.928827 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00c369-87a8-4a81-9018-a5b67e98f902 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:01.929546 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00c369-87a8-4a81-9018-a5b67e98f902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:01.930557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-8e00c369-87a8-4a81-9018-a5b67e98f902 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:01.930557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:01.930557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:01.931803 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00c369-87a8-4a81-9018-a5b67e98f902 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:01.957021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 27/45] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:15:01 2021] POST /identity/v3/projects => generated 312 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:03.281591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ce0b4-d060-4897-8f13-2f71c338e333 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:03.282141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ce0b4-d060-4897-8f13-2f71c338e333 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:03.282141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ce0b4-d060-4897-8f13-2f71c338e333 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:03.284098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 19/46] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:03.290145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c007027-e184-4fa9-86ba-54a485b7e7ab None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:03.290565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c007027-e184-4fa9-86ba-54a485b7e7ab None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:03.290747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c007027-e184-4fa9-86ba-54a485b7e7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:03.308578 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6c007027-e184-4fa9-86ba-54a485b7e7ab None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:03.309763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6c007027-e184-4fa9-86ba-54a485b7e7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:03.363759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 28/47] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:03.387748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ce0b4-d060-4897-8f13-2f71c338e333 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:03.399829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ce0b4-d060-4897-8f13-2f71c338e333 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:03.403967 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bea31d-476d-4360-bcd8-4c8f9972dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:03.404746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bea31d-476d-4360-bcd8-4c8f9972dccd admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:03.405034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bea31d-476d-4360-bcd8-4c8f9972dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:03.405313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bea31d-476d-4360-bcd8-4c8f9972dccd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:03.415966 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bea31d-476d-4360-bcd8-4c8f9972dccd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:03.422654 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-e5bea31d-476d-4360-bcd8-4c8f9972dccd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:03.423818 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 20/48] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:03.430749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c007027-e184-4fa9-86ba-54a485b7e7ab None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:03.439435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c007027-e184-4fa9-86ba-54a485b7e7ab None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:03.443777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0ff8b-c00b-4fc2-913e-3fe6edef4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:03.444431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ff8b-c00b-4fc2-913e-3fe6edef4d13 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:03.444721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ff8b-c00b-4fc2-913e-3fe6edef4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:03.445004 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ff8b-c00b-4fc2-913e-3fe6edef4d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:03.445758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0ff8b-c00b-4fc2-913e-3fe6edef4d13 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:03.446067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0ff8b-c00b-4fc2-913e-3fe6edef4d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:03.447702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0ff8b-c00b-4fc2-913e-3fe6edef4d13 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:03.455670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 29/49] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:03.461936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bea31d-476d-4360-bcd8-4c8f9972dccd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:03.471761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bea31d-476d-4360-bcd8-4c8f9972dccd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:03.476732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d0cf-003d-4adb-9094-b512f5d666a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:03.477577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d0cf-003d-4adb-9094-b512f5d666a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:03.477869 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d0cf-003d-4adb-9094-b512f5d666a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:03.478152 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d0cf-003d-4adb-9094-b512f5d666a7 admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:03.479588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d0cf-003d-4adb-9094-b512f5d666a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:03.481404 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d0cf-003d-4adb-9094-b512f5d666a7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:03.483184 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 21/50] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:03 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:03.489894 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0ff8b-c00b-4fc2-913e-3fe6edef4d13 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:03.499594 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0ff8b-c00b-4fc2-913e-3fe6edef4d13 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:03.503983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b78da2-483b-4e2b-be15-95cb918e468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:03.504778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78da2-483b-4e2b-be15-95cb918e468d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:03.505230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78da2-483b-4e2b-be15-95cb918e468d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:03.505405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78da2-483b-4e2b-be15-95cb918e468d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:03.506586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b78da2-483b-4e2b-be15-95cb918e468d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:03.508400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b78da2-483b-4e2b-be15-95cb918e468d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:03.509998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 30/51] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:03.516658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d0cf-003d-4adb-9094-b512f5d666a7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:03.526762 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d0cf-003d-4adb-9094-b512f5d666a7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:03.531094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e661c-e1aa-4667-b6ed-51aa850fafdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:03.531793 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e661c-e1aa-4667-b6ed-51aa850fafdb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:03.532019 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e661c-e1aa-4667-b6ed-51aa850fafdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:03.532299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e661c-e1aa-4667-b6ed-51aa850fafdb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:03.533130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e661c-e1aa-4667-b6ed-51aa850fafdb admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.domain.id=default, user.id=3c48fa6914a840d99c4665f7fb9f25b2) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:03.533443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e661c-e1aa-4667-b6ed-51aa850fafdb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:03.535323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e661c-e1aa-4667-b6ed-51aa850fafdb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:03.541522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 22/52] 10.222.0.23 () {56 vars in 1344 bytes} [Wed Aug 25 01:15:03 2021] GET /identity/v3/role_assignments?user.id=3c48fa6914a840d99c4665f7fb9f25b2&scope.domain.id=default&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:04.080158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4e0a-a233-429b-b237-c631c5aa4d09 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:04.080451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4e0a-a233-429b-b237-c631c5aa4d09 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:04.080733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4e0a-a233-429b-b237-c631c5aa4d09 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:04.082497 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 31/53] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:04.088816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0518-ee5d-4547-97d3-05a0db6a05d8 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:04.089114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0518-ee5d-4547-97d3-05a0db6a05d8 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:04.089422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0518-ee5d-4547-97d3-05a0db6a05d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:04.106439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-bd3c0518-ee5d-4547-97d3-05a0db6a05d8 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:04.107646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-bd3c0518-ee5d-4547-97d3-05a0db6a05d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:04.114949 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 23/54] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:04.138892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4e0a-a233-429b-b237-c631c5aa4d09 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:04.151232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4e0a-a233-429b-b237-c631c5aa4d09 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:04.155413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ec136-3112-47f1-9882-121a5293cf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:04.156176 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ec136-3112-47f1-9882-121a5293cf3c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:04.156462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ec136-3112-47f1-9882-121a5293cf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:04.156739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ec136-3112-47f1-9882-121a5293cf3c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:04.157878 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ec136-3112-47f1-9882-121a5293cf3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:04.159591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ec136-3112-47f1-9882-121a5293cf3c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:04.161124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 32/55] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:04.166693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0518-ee5d-4547-97d3-05a0db6a05d8 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:04.175247 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0518-ee5d-4547-97d3-05a0db6a05d8 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:04.179541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2aae-ba79-4d4f-b6ff-e165fd429d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:04.180175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2aae-ba79-4d4f-b6ff-e165fd429d11 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:04.180460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2aae-ba79-4d4f-b6ff-e165fd429d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:04.180770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2aae-ba79-4d4f-b6ff-e165fd429d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:04.181468 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad2aae-ba79-4d4f-b6ff-e165fd429d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:04.183408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad2aae-ba79-4d4f-b6ff-e165fd429d11 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:04.206989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 24/56] 10.222.0.23 () {60 vars in 1162 bytes} [Wed Aug 25 01:15:04 2021] POST /identity/v3/projects => generated 298 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:06.323898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d7da-02af-4cac-ad0a-2b4fce95b119 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:06.324418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d7da-02af-4cac-ad0a-2b4fce95b119 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:06.324505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d7da-02af-4cac-ad0a-2b4fce95b119 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:06.326222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 33/57] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:06.332051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f156-321b-4496-8856-ce04e447bf50 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:06.332446 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f156-321b-4496-8856-ce04e447bf50 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:06.332614 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f156-321b-4496-8856-ce04e447bf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:06.350113 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-8dd0f156-321b-4496-8856-ce04e447bf50 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:06.351314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8dd0f156-321b-4496-8856-ce04e447bf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:06.404622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 25/58] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:06.430257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d7da-02af-4cac-ad0a-2b4fce95b119 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:06.442014 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d7da-02af-4cac-ad0a-2b4fce95b119 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:06.446226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64af04-9d53-430c-b789-506b09cdaf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:06.447029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64af04-9d53-430c-b789-506b09cdaf74 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:06.447320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64af04-9d53-430c-b789-506b09cdaf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:06.447601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64af04-9d53-430c-b789-506b09cdaf74 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:06.448752 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64af04-9d53-430c-b789-506b09cdaf74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:06.450436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64af04-9d53-430c-b789-506b09cdaf74 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:06.451986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 34/59] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:06.457429 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0f156-321b-4496-8856-ce04e447bf50 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:06.466327 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0f156-321b-4496-8856-ce04e447bf50 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:06.470599 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565969d-0c86-404b-9925-f9ec5d0dd1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:06.471268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565969d-0c86-404b-9925-f9ec5d0dd1cc admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:06.471552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565969d-0c86-404b-9925-f9ec5d0dd1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:06.471828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565969d-0c86-404b-9925-f9ec5d0dd1cc admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:06.472529 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565969d-0c86-404b-9925-f9ec5d0dd1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:06.473515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-f565969d-0c86-404b-9925-f9ec5d0dd1cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:06.473515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:06.473515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:06.475402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565969d-0c86-404b-9925-f9ec5d0dd1cc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:06.499654 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 26/60] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:15:06 2021] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:15:09.478705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e67c-818d-432b-b779-23e4e1ecfa99 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.479767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e67c-818d-432b-b779-23e4e1ecfa99 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.480258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e67c-818d-432b-b779-23e4e1ecfa99 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.482501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 35/61] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:09.488813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b62b-55c3-4b71-84ef-5313374d7d63 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.490488 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b62b-55c3-4b71-84ef-5313374d7d63 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.491020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b62b-55c3-4b71-84ef-5313374d7d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.525024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-df74b62b-55c3-4b71-84ef-5313374d7d63 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:09.526523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-df74b62b-55c3-4b71-84ef-5313374d7d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:09.540883 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 27/62] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:09.584571 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552e67c-818d-432b-b779-23e4e1ecfa99 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:09.600733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552e67c-818d-432b-b779-23e4e1ecfa99 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:09.605500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67486960-cdd0-4ef2-a082-f209840a85ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:09.606532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67486960-cdd0-4ef2-a082-f209840a85ac admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.607038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67486960-cdd0-4ef2-a082-f209840a85ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.607560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67486960-cdd0-4ef2-a082-f209840a85ac admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.621280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67486960-cdd0-4ef2-a082-f209840a85ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:09.636747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-67486960-cdd0-4ef2-a082-f209840a85ac admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:09.638892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 36/63] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:09.644994 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74b62b-55c3-4b71-84ef-5313374d7d63 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:09.655096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74b62b-55c3-4b71-84ef-5313374d7d63 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:09.668206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b00c41-c128-4b37-9e8f-458a7df138e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:09.669123 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00c41-c128-4b37-9e8f-458a7df138e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.669630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00c41-c128-4b37-9e8f-458a7df138e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.670109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00c41-c128-4b37-9e8f-458a7df138e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.671121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b00c41-c128-4b37-9e8f-458a7df138e5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:09.671630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b00c41-c128-4b37-9e8f-458a7df138e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:09.673449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b00c41-c128-4b37-9e8f-458a7df138e5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:09.682607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 28/64] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:09.689417 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67486960-cdd0-4ef2-a082-f209840a85ac admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:09.707617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67486960-cdd0-4ef2-a082-f209840a85ac admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:09.718792 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8ea01-7b5a-4b8a-a1f3-88105690df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:09.719678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ea01-7b5a-4b8a-a1f3-88105690df64 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.719966 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ea01-7b5a-4b8a-a1f3-88105690df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.720246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ea01-7b5a-4b8a-a1f3-88105690df64 admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.740384 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8ea01-7b5a-4b8a-a1f3-88105690df64 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:09.742489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8ea01-7b5a-4b8a-a1f3-88105690df64 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:09.744550 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 37/65] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:09 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:09.750733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b00c41-c128-4b37-9e8f-458a7df138e5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:09.764097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b00c41-c128-4b37-9e8f-458a7df138e5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:09.775180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd969-811a-494a-883f-92e27f5997d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:09.776234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd969-811a-494a-883f-92e27f5997d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.776725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd969-811a-494a-883f-92e27f5997d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.777211 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd969-811a-494a-883f-92e27f5997d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.791031 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fd969-811a-494a-883f-92e27f5997d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:09.792873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fd969-811a-494a-883f-92e27f5997d5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:09.809498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 29/66] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:09.816395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8ea01-7b5a-4b8a-a1f3-88105690df64 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:09.831777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8ea01-7b5a-4b8a-a1f3-88105690df64 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:09.843843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b10d40-2a4d-461d-86c7-28b557a5fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:09.844714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b10d40-2a4d-461d-86c7-28b557a5fd7c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.844998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b10d40-2a4d-461d-86c7-28b557a5fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.845282 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b10d40-2a4d-461d-86c7-28b557a5fd7c admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.846457 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b10d40-2a4d-461d-86c7-28b557a5fd7c admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:09.848567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b10d40-2a4d-461d-86c7-28b557a5fd7c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:09.850589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 38/67] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:09 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:09.857172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd969-811a-494a-883f-92e27f5997d5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:09.871712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd969-811a-494a-883f-92e27f5997d5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:09.878740 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f5436-c406-481d-ac8b-7f0799ee6f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:09.879409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5436-c406-481d-ac8b-7f0799ee6f6d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.879795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5436-c406-481d-ac8b-7f0799ee6f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.880615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5436-c406-481d-ac8b-7f0799ee6f6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.881474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f5436-c406-481d-ac8b-7f0799ee6f6d admin admin] RBAC: Adding query filter params (role.id=426e730bef7e42f4bb8753fa9312a9c2, scope.project.id=749968f930fa45ba9591e86301e37c6b, user.id=2e3f36f5b5f44a18a2db871888e03bd7) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:09.881860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f5436-c406-481d-ac8b-7f0799ee6f6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:09.881976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc29ef-8daa-40ef-b7d1-84da2911d9ac None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.882194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc29ef-8daa-40ef-b7d1-84da2911d9ac None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.882477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc29ef-8daa-40ef-b7d1-84da2911d9ac None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.883820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f5436-c406-481d-ac8b-7f0799ee6f6d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:09.884600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 39/68] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:09.891372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd971e3f-d913-4c06-8850-d6e2cd953bc2 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.891672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd971e3f-d913-4c06-8850-d6e2cd953bc2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.891941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd971e3f-d913-4c06-8850-d6e2cd953bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.896497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 30/69] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:09 2021] GET /identity/v3/role_assignments?user.id=2e3f36f5b5f44a18a2db871888e03bd7&scope.project.id=749968f930fa45ba9591e86301e37c6b&role.id=426e730bef7e42f4bb8753fa9312a9c2 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:09.928016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-cd971e3f-d913-4c06-8850-d6e2cd953bc2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:09.929247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cd971e3f-d913-4c06-8850-d6e2cd953bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:09.942412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 40/70] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:09.993642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f5436-c406-481d-ac8b-7f0799ee6f6d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:09.994704 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405c7dc-5f1b-4f74-beb2-fa8598ca85d9 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:09.995023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405c7dc-5f1b-4f74-beb2-fa8598ca85d9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:09.995311 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405c7dc-5f1b-4f74-beb2-fa8598ca85d9 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:09.997088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 41/71] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:10.004928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f5436-c406-481d-ac8b-7f0799ee6f6d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.011401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fd34b-903a-4097-ae0a-d734817b973e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.011691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fd34b-903a-4097-ae0a-d734817b973e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.011978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fd34b-903a-4097-ae0a-d734817b973e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.013674 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca3854-63cb-4e53-8d34-2330dbdd2f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.014486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca3854-63cb-4e53-8d34-2330dbdd2f47 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.014795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca3854-63cb-4e53-8d34-2330dbdd2f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.015147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca3854-63cb-4e53-8d34-2330dbdd2f47 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.037197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca3854-63cb-4e53-8d34-2330dbdd2f47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:10.043819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b75fd34b-903a-4097-ae0a-d734817b973e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:10.044177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-47ca3854-63cb-4e53-8d34-2330dbdd2f47 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:10.045052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b75fd34b-903a-4097-ae0a-d734817b973e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:10.045781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 31/72] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:10.052302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca3854-63cb-4e53-8d34-2330dbdd2f47 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.062348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 42/73] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:10.077071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca3854-63cb-4e53-8d34-2330dbdd2f47 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.081625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc66957-a44d-4b68-999d-3db502e4573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.082296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66957-a44d-4b68-999d-3db502e4573a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.082580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66957-a44d-4b68-999d-3db502e4573a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.082885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66957-a44d-4b68-999d-3db502e4573a admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.084218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc66957-a44d-4b68-999d-3db502e4573a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:10.084528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc66957-a44d-4b68-999d-3db502e4573a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.086149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc66957-a44d-4b68-999d-3db502e4573a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.089118 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fd34b-903a-4097-ae0a-d734817b973e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.101089 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fd34b-903a-4097-ae0a-d734817b973e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.103956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 32/74] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:10.110521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc66957-a44d-4b68-999d-3db502e4573a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.116241 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001748a-87ba-41fb-82ee-632394d417f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.117394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001748a-87ba-41fb-82ee-632394d417f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.117875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001748a-87ba-41fb-82ee-632394d417f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.118395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001748a-87ba-41fb-82ee-632394d417f9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.121801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc66957-a44d-4b68-999d-3db502e4573a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.126436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2036d3d-fae3-439f-9fa5-fa838678434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.127546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036d3d-fae3-439f-9fa5-fa838678434b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.128003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036d3d-fae3-439f-9fa5-fa838678434b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.128443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036d3d-fae3-439f-9fa5-fa838678434b admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.129803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2036d3d-fae3-439f-9fa5-fa838678434b admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.132580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2036d3d-fae3-439f-9fa5-fa838678434b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.134375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 33/75] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:10.139610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001748a-87ba-41fb-82ee-632394d417f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:10.143919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2036d3d-fae3-439f-9fa5-fa838678434b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.158481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-f001748a-87ba-41fb-82ee-632394d417f9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:10.159832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2036d3d-fae3-439f-9fa5-fa838678434b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.161422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 43/76] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:10.166356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103ed72-a6b3-4177-8963-56f5250fb606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.167916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001748a-87ba-41fb-82ee-632394d417f9 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.168741 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103ed72-a6b3-4177-8963-56f5250fb606 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.172881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103ed72-a6b3-4177-8963-56f5250fb606 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.174536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103ed72-a6b3-4177-8963-56f5250fb606 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.185244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001748a-87ba-41fb-82ee-632394d417f9 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.192327 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103ed72-a6b3-4177-8963-56f5250fb606 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.195316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7932aa-f9ce-4077-83f4-b4c8b82bba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.196926 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7932aa-f9ce-4077-83f4-b4c8b82bba62 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.197644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103ed72-a6b3-4177-8963-56f5250fb606 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.198131 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7932aa-f9ce-4077-83f4-b4c8b82bba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.199589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7932aa-f9ce-4077-83f4-b4c8b82bba62 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.200514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7932aa-f9ce-4077-83f4-b4c8b82bba62 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:10.203190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7932aa-f9ce-4077-83f4-b4c8b82bba62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.205530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7932aa-f9ce-4077-83f4-b4c8b82bba62 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.218407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 34/77] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:15:10.222897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 44/78] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:10.224878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103ed72-a6b3-4177-8963-56f5250fb606 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.229602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7932aa-f9ce-4077-83f4-b4c8b82bba62 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.240120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103ed72-a6b3-4177-8963-56f5250fb606 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.246447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7932aa-f9ce-4077-83f4-b4c8b82bba62 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.253299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721be1-a910-4fe6-8c88-58dfbf987a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.254839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721be1-a910-4fe6-8c88-58dfbf987a62 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.256258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721be1-a910-4fe6-8c88-58dfbf987a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.257739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5b96f-562d-49af-9e4f-d3e8dac33cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.258036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721be1-a910-4fe6-8c88-58dfbf987a62 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.260176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721be1-a910-4fe6-8c88-58dfbf987a62 admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.260519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5b96f-562d-49af-9e4f-d3e8dac33cce admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.261318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5b96f-562d-49af-9e4f-d3e8dac33cce admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.262847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5b96f-562d-49af-9e4f-d3e8dac33cce admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.264533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5b96f-562d-49af-9e4f-d3e8dac33cce admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.265589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721be1-a910-4fe6-8c88-58dfbf987a62 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.269697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 35/79] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:10.270000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5b96f-562d-49af-9e4f-d3e8dac33cce admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.271901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 45/80] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:10.279016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721be1-a910-4fe6-8c88-58dfbf987a62 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.280294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5b96f-562d-49af-9e4f-d3e8dac33cce admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.289090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721be1-a910-4fe6-8c88-58dfbf987a62 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.296249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3914d7-c280-4288-9282-3ef24ab5548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.296942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3914d7-c280-4288-9282-3ef24ab5548a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.297229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3914d7-c280-4288-9282-3ef24ab5548a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.297509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3914d7-c280-4288-9282-3ef24ab5548a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.298381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3914d7-c280-4288-9282-3ef24ab5548a admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=749968f930fa45ba9591e86301e37c6b, user.id=3c48fa6914a840d99c4665f7fb9f25b2) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:10.298716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3914d7-c280-4288-9282-3ef24ab5548a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.299649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5b96f-562d-49af-9e4f-d3e8dac33cce admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.302921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3914d7-c280-4288-9282-3ef24ab5548a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.310806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 36/81] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/role_assignments?user.id=3c48fa6914a840d99c4665f7fb9f25b2&scope.project.id=749968f930fa45ba9591e86301e37c6b&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:10.312379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ac488-9843-4bdf-a80e-6eba77bc74b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.313091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ac488-9843-4bdf-a80e-6eba77bc74b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.313376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ac488-9843-4bdf-a80e-6eba77bc74b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.313653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ac488-9843-4bdf-a80e-6eba77bc74b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.327763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ac488-9843-4bdf-a80e-6eba77bc74b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.329655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ac488-9843-4bdf-a80e-6eba77bc74b1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.342716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 46/82] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:10.349444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3914d7-c280-4288-9282-3ef24ab5548a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.362080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3914d7-c280-4288-9282-3ef24ab5548a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.370600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccaf72-2e73-4afe-92cd-71d51f9c0663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.371563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccaf72-2e73-4afe-92cd-71d51f9c0663 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.371900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccaf72-2e73-4afe-92cd-71d51f9c0663 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.372177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccaf72-2e73-4afe-92cd-71d51f9c0663 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.373569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccaf72-2e73-4afe-92cd-71d51f9c0663 admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.375860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccaf72-2e73-4afe-92cd-71d51f9c0663 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.377722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 37/83] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:10.385490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ac488-9843-4bdf-a80e-6eba77bc74b1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.396993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ac488-9843-4bdf-a80e-6eba77bc74b1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.402486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b5296-3e21-4994-b207-e7a4c4d65ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.403220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b5296-3e21-4994-b207-e7a4c4d65ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.403506 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b5296-3e21-4994-b207-e7a4c4d65ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.403783 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b5296-3e21-4994-b207-e7a4c4d65ed5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.404726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b5296-3e21-4994-b207-e7a4c4d65ed5 admin admin] RBAC: Adding query filter params (role.id=b3e69d8143774de5aa40d1fd070a8c03, scope.project.id=749968f930fa45ba9591e86301e37c6b, user.id=2e3f36f5b5f44a18a2db871888e03bd7) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:10.405040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b5296-3e21-4994-b207-e7a4c4d65ed5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.406160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-db9b5296-3e21-4994-b207-e7a4c4d65ed5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:10.406160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:10.406160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:10.407421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b5296-3e21-4994-b207-e7a4c4d65ed5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.415327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 47/84] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/role_assignments?user.id=2e3f36f5b5f44a18a2db871888e03bd7&scope.project.id=749968f930fa45ba9591e86301e37c6b&role.id=b3e69d8143774de5aa40d1fd070a8c03 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:10.440448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275800b-72bc-4b6c-ae85-22380a7b5ff2 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.440765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275800b-72bc-4b6c-ae85-22380a7b5ff2 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.441009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275800b-72bc-4b6c-ae85-22380a7b5ff2 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.443597 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 38/85] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:10.450505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fcd71-6503-478e-922c-4e20e193f90c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.450856 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fcd71-6503-478e-922c-4e20e193f90c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.451134 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fcd71-6503-478e-922c-4e20e193f90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.479159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-873fcd71-6503-478e-922c-4e20e193f90c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:10.480376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-873fcd71-6503-478e-922c-4e20e193f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:10.501288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 48/86] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:10.511202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e027-1be1-4154-942f-55ae1133e74a None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.511734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e027-1be1-4154-942f-55ae1133e74a None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.511734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e027-1be1-4154-942f-55ae1133e74a None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.514052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 39/87] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:10.520232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a28f6-a380-486c-afd1-c312f02599dc None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.520511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a28f6-a380-486c-afd1-c312f02599dc None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.520847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a28f6-a380-486c-afd1-c312f02599dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.548003 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-979a28f6-a380-486c-afd1-c312f02599dc None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:10.549281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-979a28f6-a380-486c-afd1-c312f02599dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:10.561298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e027-1be1-4154-942f-55ae1133e74a None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.561559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 49/88] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:10.576562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e027-1be1-4154-942f-55ae1133e74a None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.585286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c11db7-3923-44c3-aa84-3cb3384db38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.585619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c11db7-3923-44c3-aa84-3cb3384db38b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.585866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c11db7-3923-44c3-aa84-3cb3384db38b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.586147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c11db7-3923-44c3-aa84-3cb3384db38b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.586314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a28f6-a380-486c-afd1-c312f02599dc None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.597613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a28f6-a380-486c-afd1-c312f02599dc None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.608922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ff2f1-4087-42b4-8210-ff1753b8a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.610705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ff2f1-4087-42b4-8210-ff1753b8a45a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.611202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ff2f1-4087-42b4-8210-ff1753b8a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.612620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ff2f1-4087-42b4-8210-ff1753b8a45a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.615551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c11db7-3923-44c3-aa84-3cb3384db38b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:10.618722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ff2f1-4087-42b4-8210-ff1753b8a45a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.621133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ff2f1-4087-42b4-8210-ff1753b8a45a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.626898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 50/89] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:10.628605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-80c11db7-3923-44c3-aa84-3cb3384db38b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:10.630206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 40/90] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:10.635738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ff2f1-4087-42b4-8210-ff1753b8a45a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.637052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c11db7-3923-44c3-aa84-3cb3384db38b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.652343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ff2f1-4087-42b4-8210-ff1753b8a45a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.659669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c11db7-3923-44c3-aa84-3cb3384db38b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.664839 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8bd70-4641-40f7-8703-40d79a06d738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.665519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8bd70-4641-40f7-8703-40d79a06d738 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.666084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8bd70-4641-40f7-8703-40d79a06d738 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.666367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8bd70-4641-40f7-8703-40d79a06d738 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.667107 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8bd70-4641-40f7-8703-40d79a06d738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.669026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8bd70-4641-40f7-8703-40d79a06d738 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.671963 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece84a8-91a7-4ae8-8331-2e39bb24ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.672634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece84a8-91a7-4ae8-8331-2e39bb24ac0d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.672920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece84a8-91a7-4ae8-8331-2e39bb24ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.673202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece84a8-91a7-4ae8-8331-2e39bb24ac0d admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.673961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece84a8-91a7-4ae8-8331-2e39bb24ac0d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:10.674272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece84a8-91a7-4ae8-8331-2e39bb24ac0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.676536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece84a8-91a7-4ae8-8331-2e39bb24ac0d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.694291 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 41/91] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:10.698718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 51/92] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:15:10 2021] POST /identity/v3/projects => generated 302 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:10.701001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece84a8-91a7-4ae8-8331-2e39bb24ac0d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.716481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece84a8-91a7-4ae8-8331-2e39bb24ac0d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.808491 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b218c-3990-481e-8399-b15f57b524f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.809319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b218c-3990-481e-8399-b15f57b524f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.809609 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b218c-3990-481e-8399-b15f57b524f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.809893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b218c-3990-481e-8399-b15f57b524f3 admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.811212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b218c-3990-481e-8399-b15f57b524f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.813428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b218c-3990-481e-8399-b15f57b524f3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.815363 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 42/93] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:10.823510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8bd70-4641-40f7-8703-40d79a06d738 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.840083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8bd70-4641-40f7-8703-40d79a06d738 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.845108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00965bc-9d79-442c-a99a-033e91a66ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.846075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00965bc-9d79-442c-a99a-033e91a66ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.846561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00965bc-9d79-442c-a99a-033e91a66ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.847085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00965bc-9d79-442c-a99a-033e91a66ef1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.856843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00965bc-9d79-442c-a99a-033e91a66ef1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.859039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00965bc-9d79-442c-a99a-033e91a66ef1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.869928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 52/94] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:10.876314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b218c-3990-481e-8399-b15f57b524f3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.896068 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b218c-3990-481e-8399-b15f57b524f3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.906862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2c6fc-78b4-4205-bdaf-1891d7cce13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.907733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c6fc-78b4-4205-bdaf-1891d7cce13c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.908019 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c6fc-78b4-4205-bdaf-1891d7cce13c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.908300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c6fc-78b4-4205-bdaf-1891d7cce13c admin admin] PATH_INFO: `/v3/projects/da9f11a9f3614d1eb83a61ce4af23a43` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.909497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2c6fc-78b4-4205-bdaf-1891d7cce13c admin admin] RBAC: Authorizing `identity:get_project(project_id=da9f11a9f3614d1eb83a61ce4af23a43)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.912138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2c6fc-78b4-4205-bdaf-1891d7cce13c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.913968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 43/95] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/projects/da9f11a9f3614d1eb83a61ce4af23a43 => generated 312 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:10.920561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00965bc-9d79-442c-a99a-033e91a66ef1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:10.930710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00965bc-9d79-442c-a99a-033e91a66ef1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:10.935509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b501d93-0738-4317-9720-3fb2372e7d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:10.936400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501d93-0738-4317-9720-3fb2372e7d00 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:10.936882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501d93-0738-4317-9720-3fb2372e7d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:10.937356 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501d93-0738-4317-9720-3fb2372e7d00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:10.938371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501d93-0738-4317-9720-3fb2372e7d00 admin admin] RBAC: Adding query filter params (role.id=426e730bef7e42f4bb8753fa9312a9c2, scope.project.id=da9f11a9f3614d1eb83a61ce4af23a43, user.id=2e3f36f5b5f44a18a2db871888e03bd7) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:10.938936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501d93-0738-4317-9720-3fb2372e7d00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:10.940976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501d93-0738-4317-9720-3fb2372e7d00 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:10.947067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 53/96] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:10 2021] GET /identity/v3/role_assignments?user.id=2e3f36f5b5f44a18a2db871888e03bd7&scope.project.id=da9f11a9f3614d1eb83a61ce4af23a43&role.id=426e730bef7e42f4bb8753fa9312a9c2 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:12.564708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43586111-d1b7-4aa1-aa15-3034076e8775 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:12.565674 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43586111-d1b7-4aa1-aa15-3034076e8775 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:12.566156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43586111-d1b7-4aa1-aa15-3034076e8775 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:12.568473 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 44/97] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:12.574146 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e8dac-4342-4899-be22-ac0d9fcdb5f9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:12.575033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e8dac-4342-4899-be22-ac0d9fcdb5f9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:12.575513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e8dac-4342-4899-be22-ac0d9fcdb5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:12.603692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2a7e8dac-4342-4899-be22-ac0d9fcdb5f9 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:12.605357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2a7e8dac-4342-4899-be22-ac0d9fcdb5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:12.613824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 54/98] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:12.647809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43586111-d1b7-4aa1-aa15-3034076e8775 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:12.665020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43586111-d1b7-4aa1-aa15-3034076e8775 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:12.669761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6fb4c-9e28-4d74-af19-aefa2e21c9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:12.670790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6fb4c-9e28-4d74-af19-aefa2e21c9ca admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:12.671276 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6fb4c-9e28-4d74-af19-aefa2e21c9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:12.671773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6fb4c-9e28-4d74-af19-aefa2e21c9ca admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:12.687527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6fb4c-9e28-4d74-af19-aefa2e21c9ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:12.694554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-f0c6fb4c-9e28-4d74-af19-aefa2e21c9ca admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:12.700016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 45/99] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:12.706727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e8dac-4342-4899-be22-ac0d9fcdb5f9 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:12.717902 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e8dac-4342-4899-be22-ac0d9fcdb5f9 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:12.727258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b21d2-51c8-4890-b105-1dd41ded240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:12.728156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b21d2-51c8-4890-b105-1dd41ded240a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:12.728642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b21d2-51c8-4890-b105-1dd41ded240a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:12.729136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b21d2-51c8-4890-b105-1dd41ded240a admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:12.730090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b21d2-51c8-4890-b105-1dd41ded240a admin admin] RBAC: Adding query filter params (name=member) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:12.730591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b21d2-51c8-4890-b105-1dd41ded240a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:12.732519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b21d2-51c8-4890-b105-1dd41ded240a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:12.741574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 55/100] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:12.747436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6fb4c-9e28-4d74-af19-aefa2e21c9ca admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:12.760973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6fb4c-9e28-4d74-af19-aefa2e21c9ca admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:12.765997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186b5a2-06fe-4b0e-9430-e742861ba44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:12.767183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186b5a2-06fe-4b0e-9430-e742861ba44f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:12.767673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186b5a2-06fe-4b0e-9430-e742861ba44f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:12.768146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186b5a2-06fe-4b0e-9430-e742861ba44f admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:12.769537 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186b5a2-06fe-4b0e-9430-e742861ba44f admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:12.772458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186b5a2-06fe-4b0e-9430-e742861ba44f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:12.774224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 46/101] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:12 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:12.780197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b21d2-51c8-4890-b105-1dd41ded240a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:12.795710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b21d2-51c8-4890-b105-1dd41ded240a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:12.803281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19238dc3-6511-4ad7-8815-a2d129a42c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:12.804438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238dc3-6511-4ad7-8815-a2d129a42c0d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:12.804954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238dc3-6511-4ad7-8815-a2d129a42c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:12.805430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238dc3-6511-4ad7-8815-a2d129a42c0d admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:12.806885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19238dc3-6511-4ad7-8815-a2d129a42c0d admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:12.809407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19238dc3-6511-4ad7-8815-a2d129a42c0d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:12.811326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 56/102] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:12 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:12.818051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186b5a2-06fe-4b0e-9430-e742861ba44f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:12.828417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186b5a2-06fe-4b0e-9430-e742861ba44f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:12.838735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800d52b-9e60-4fca-9476-b767e8334fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:12.839890 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d52b-9e60-4fca-9476-b767e8334fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:12.840376 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d52b-9e60-4fca-9476-b767e8334fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:12.840909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800d52b-9e60-4fca-9476-b767e8334fcb admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b/users/2e3f36f5b5f44a18a2db871888e03bd7/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:12.843271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800d52b-9e60-4fca-9476-b767e8334fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=749968f930fa45ba9591e86301e37c6b, user_id=2e3f36f5b5f44a18a2db871888e03bd7, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:12.844502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-9800d52b-9e60-4fca-9476-b767e8334fcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:12.844502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:12.844502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:12.846821 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800d52b-9e60-4fca-9476-b767e8334fcb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:12.877181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 47/103] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:12 2021] PUT /identity/v3/projects/749968f930fa45ba9591e86301e37c6b/users/2e3f36f5b5f44a18a2db871888e03bd7/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:13.076187 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38f06-7285-4b19-84f3-5799c3464c54 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.076911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38f06-7285-4b19-84f3-5799c3464c54 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.077414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38f06-7285-4b19-84f3-5799c3464c54 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.079564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 57/104] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:13.105095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b15b6a-3344-4f4c-814a-279a4dc33085 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.105729 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b15b6a-3344-4f4c-814a-279a4dc33085 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.106207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b15b6a-3344-4f4c-814a-279a4dc33085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.130547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d642-9e3c-4568-b60e-53a668362fb8 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.131235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d642-9e3c-4568-b60e-53a668362fb8 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.131776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d642-9e3c-4568-b60e-53a668362fb8 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.133733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 58/105] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:13.136303 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-65b15b6a-3344-4f4c-814a-279a4dc33085 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:13.137798 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-65b15b6a-3344-4f4c-814a-279a4dc33085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:13.139907 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66bb60-b221-4341-a372-956c8ccd2685 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.140402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66bb60-b221-4341-a372-956c8ccd2685 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.140895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66bb60-b221-4341-a372-956c8ccd2685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.171601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-4a66bb60-b221-4341-a372-956c8ccd2685 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:13.173800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4a66bb60-b221-4341-a372-956c8ccd2685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:13.240159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 59/106] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:13.251406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 48/107] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:13.275355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66bb60-b221-4341-a372-956c8ccd2685 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.285120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66bb60-b221-4341-a372-956c8ccd2685 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.286749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b15b6a-3344-4f4c-814a-279a4dc33085 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.296497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b15b6a-3344-4f4c-814a-279a4dc33085 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.300936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc71d-95a0-4461-ad19-a682b7cd4ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.302278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc71d-95a0-4461-ad19-a682b7cd4ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.302566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc71d-95a0-4461-ad19-a682b7cd4ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.303390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc71d-95a0-4461-ad19-a682b7cd4ef4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.304334 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b456291-3db6-46de-83e7-00348cb15258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.305103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b456291-3db6-46de-83e7-00348cb15258 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.305379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b456291-3db6-46de-83e7-00348cb15258 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.305648 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b456291-3db6-46de-83e7-00348cb15258 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.321439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b456291-3db6-46de-83e7-00348cb15258 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:13.328991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-5b456291-3db6-46de-83e7-00348cb15258 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:13.330343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 49/108] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:13.331068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffc71d-95a0-4461-ad19-a682b7cd4ef4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:13.339239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-72ffc71d-95a0-4461-ad19-a682b7cd4ef4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:13.340041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 60/109] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:13.340636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b456291-3db6-46de-83e7-00348cb15258 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.346269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc71d-95a0-4461-ad19-a682b7cd4ef4 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.361432 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b456291-3db6-46de-83e7-00348cb15258 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.366147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc71d-95a0-4461-ad19-a682b7cd4ef4 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.372538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f2e28-f474-4cbd-b3b3-676e924fbef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.373204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f2e28-f474-4cbd-b3b3-676e924fbef5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.373490 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f2e28-f474-4cbd-b3b3-676e924fbef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.373766 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f2e28-f474-4cbd-b3b3-676e924fbef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.374511 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f2e28-f474-4cbd-b3b3-676e924fbef5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:13.374841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f2e28-f474-4cbd-b3b3-676e924fbef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.376449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f2e28-f474-4cbd-b3b3-676e924fbef5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.379120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35773-6151-4dd4-b193-6a283e727907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.379784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35773-6151-4dd4-b193-6a283e727907 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.380707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35773-6151-4dd4-b193-6a283e727907 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.380986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35773-6151-4dd4-b193-6a283e727907 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.381729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b35773-6151-4dd4-b193-6a283e727907 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:13.382036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b35773-6151-4dd4-b193-6a283e727907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.383667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b35773-6151-4dd4-b193-6a283e727907 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.398587 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 50/110] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:13.406518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 61/111] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:13.408831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f2e28-f474-4cbd-b3b3-676e924fbef5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.420084 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f2e28-f474-4cbd-b3b3-676e924fbef5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.426616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35773-6151-4dd4-b193-6a283e727907 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.438399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35773-6151-4dd4-b193-6a283e727907 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.441090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55667ce9-5301-4f46-bfcf-b9c59cc3cc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.441965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55667ce9-5301-4f46-bfcf-b9c59cc3cc07 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.442243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55667ce9-5301-4f46-bfcf-b9c59cc3cc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.443079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55667ce9-5301-4f46-bfcf-b9c59cc3cc07 admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.444493 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55667ce9-5301-4f46-bfcf-b9c59cc3cc07 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.446413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55667ce9-5301-4f46-bfcf-b9c59cc3cc07 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.448044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 51/112] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:13.454223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55667ce9-5301-4f46-bfcf-b9c59cc3cc07 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.456308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9c9ea-567d-417f-ad44-5d61757e86ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.457187 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9c9ea-567d-417f-ad44-5d61757e86ac admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.457471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9c9ea-567d-417f-ad44-5d61757e86ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.457746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9c9ea-567d-417f-ad44-5d61757e86ac admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.463099 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9c9ea-567d-417f-ad44-5d61757e86ac admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.465874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9c9ea-567d-417f-ad44-5d61757e86ac admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.468069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 62/113] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:13.469970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55667ce9-5301-4f46-bfcf-b9c59cc3cc07 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.474000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9c9ea-567d-417f-ad44-5d61757e86ac admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.480209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e76614-9b57-44cc-bbca-6a20aba9463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.481072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76614-9b57-44cc-bbca-6a20aba9463d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.481356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76614-9b57-44cc-bbca-6a20aba9463d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.481646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76614-9b57-44cc-bbca-6a20aba9463d admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.483849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e76614-9b57-44cc-bbca-6a20aba9463d admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.483955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9c9ea-567d-417f-ad44-5d61757e86ac admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.486868 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e76614-9b57-44cc-bbca-6a20aba9463d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.488723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2edc9-741a-4f72-9f1a-79b6e9b9371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.489819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 52/114] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:13.490287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2edc9-741a-4f72-9f1a-79b6e9b9371a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.490637 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2edc9-741a-4f72-9f1a-79b6e9b9371a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.491015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2edc9-741a-4f72-9f1a-79b6e9b9371a admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.491906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7969-c059-4324-bd8e-710f45f2c6c0 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.492369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7969-c059-4324-bd8e-710f45f2c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.492482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2edc9-741a-4f72-9f1a-79b6e9b9371a admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.492930 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7969-c059-4324-bd8e-710f45f2c6c0 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.494746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 53/115] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:13.494866 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2edc9-741a-4f72-9f1a-79b6e9b9371a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.498721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 63/116] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:13.502717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa086-cb78-445b-b343-fabdeb97258f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.502717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa086-cb78-445b-b343-fabdeb97258f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.502717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa086-cb78-445b-b343-fabdeb97258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.503591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2edc9-741a-4f72-9f1a-79b6e9b9371a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.515065 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2edc9-741a-4f72-9f1a-79b6e9b9371a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.519733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a92c6-b26b-4ad0-b0af-fe91769952f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.520356 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a92c6-b26b-4ad0-b0af-fe91769952f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.520691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a92c6-b26b-4ad0-b0af-fe91769952f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.520976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a92c6-b26b-4ad0-b0af-fe91769952f6 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b/users/3c48fa6914a840d99c4665f7fb9f25b2/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.522953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a92c6-b26b-4ad0-b0af-fe91769952f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749968f930fa45ba9591e86301e37c6b, user_id=3c48fa6914a840d99c4665f7fb9f25b2, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.525768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a92c6-b26b-4ad0-b0af-fe91769952f6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.526256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-06aaa086-cb78-445b-b343-fabdeb97258f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:13.527765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-06aaa086-cb78-445b-b343-fabdeb97258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:13.540387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 54/117] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:13.541665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaa086-cb78-445b-b343-fabdeb97258f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.545215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 64/118] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:13 2021] PUT /identity/v3/projects/749968f930fa45ba9591e86301e37c6b/users/3c48fa6914a840d99c4665f7fb9f25b2/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:13.557780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaa086-cb78-445b-b343-fabdeb97258f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.568435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a92c6-b26b-4ad0-b0af-fe91769952f6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.638758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bde30b-f49b-4fda-9ee5-0c6a9cf865e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.640405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde30b-f49b-4fda-9ee5-0c6a9cf865e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.640923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde30b-f49b-4fda-9ee5-0c6a9cf865e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.641410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde30b-f49b-4fda-9ee5-0c6a9cf865e6 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b/users/2e3f36f5b5f44a18a2db871888e03bd7/roles/b3e69d8143774de5aa40d1fd070a8c03` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.644262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bde30b-f49b-4fda-9ee5-0c6a9cf865e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749968f930fa45ba9591e86301e37c6b, user_id=2e3f36f5b5f44a18a2db871888e03bd7, role_id=b3e69d8143774de5aa40d1fd070a8c03)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.648563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bde30b-f49b-4fda-9ee5-0c6a9cf865e6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.667915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 55/119] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:13 2021] PUT /identity/v3/projects/749968f930fa45ba9591e86301e37c6b/users/2e3f36f5b5f44a18a2db871888e03bd7/roles/b3e69d8143774de5aa40d1fd070a8c03 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:13.670644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f956-dd62-4825-a903-87a84101afcd None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.671389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f956-dd62-4825-a903-87a84101afcd None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.672050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f956-dd62-4825-a903-87a84101afcd None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.674342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 56/120] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:13.681809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e544b61-ee51-4451-a910-500dc597ce1c None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.682472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e544b61-ee51-4451-a910-500dc597ce1c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.683080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e544b61-ee51-4451-a910-500dc597ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.706374 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a92c6-b26b-4ad0-b0af-fe91769952f6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.707858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-5e544b61-ee51-4451-a910-500dc597ce1c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:13.709493 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5e544b61-ee51-4451-a910-500dc597ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:13.784370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 57/121] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:13.814641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e544b61-ee51-4451-a910-500dc597ce1c None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.824415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e544b61-ee51-4451-a910-500dc597ce1c None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.829209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19683c-d60f-45c0-b9c3-a971ec028df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.829349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea873c73-9c86-40bc-bdc8-3d5d749d003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.830188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea873c73-9c86-40bc-bdc8-3d5d749d003f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.830524 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea873c73-9c86-40bc-bdc8-3d5d749d003f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.830836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea873c73-9c86-40bc-bdc8-3d5d749d003f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.831162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19683c-d60f-45c0-b9c3-a971ec028df4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.831636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19683c-d60f-45c0-b9c3-a971ec028df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.832103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19683c-d60f-45c0-b9c3-a971ec028df4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.832221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea873c73-9c86-40bc-bdc8-3d5d749d003f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.834174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea873c73-9c86-40bc-bdc8-3d5d749d003f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.836281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 65/122] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:13.842715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea873c73-9c86-40bc-bdc8-3d5d749d003f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.849244 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19683c-d60f-45c0-b9c3-a971ec028df4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:13.853867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea873c73-9c86-40bc-bdc8-3d5d749d003f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.856909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-cc19683c-d60f-45c0-b9c3-a971ec028df4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:13.858395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 58/123] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:13.863055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9be11b-2891-43bb-8b80-db7006009218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.863823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be11b-2891-43bb-8b80-db7006009218 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.864115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be11b-2891-43bb-8b80-db7006009218 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.864965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be11b-2891-43bb-8b80-db7006009218 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.865696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9be11b-2891-43bb-8b80-db7006009218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.868300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-4f9be11b-2891-43bb-8b80-db7006009218 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:13.868300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:13.868300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:13.868300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9be11b-2891-43bb-8b80-db7006009218 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.869803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19683c-d60f-45c0-b9c3-a971ec028df4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.880823 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19683c-d60f-45c0-b9c3-a971ec028df4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.886532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6543d48-fc08-414b-88a5-4288d973b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.887821 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543d48-fc08-414b-88a5-4288d973b9ff admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.888709 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543d48-fc08-414b-88a5-4288d973b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.890499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543d48-fc08-414b-88a5-4288d973b9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.890499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6543d48-fc08-414b-88a5-4288d973b9ff admin admin] RBAC: Adding query filter params (name=member) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:13.890935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6543d48-fc08-414b-88a5-4288d973b9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.893041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6543d48-fc08-414b-88a5-4288d973b9ff admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.904755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 59/124] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:13.911885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 66/125] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:15:13 2021] POST /identity/v3/users => generated 283 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:15:13.912621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6543d48-fc08-414b-88a5-4288d973b9ff admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.923822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6543d48-fc08-414b-88a5-4288d973b9ff admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.929708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d413-cfdc-4e58-94ac-0edff53ef77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.931123 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d413-cfdc-4e58-94ac-0edff53ef77a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.931782 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d413-cfdc-4e58-94ac-0edff53ef77a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.932256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1d413-cfdc-4e58-94ac-0edff53ef77a admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.933879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1d413-cfdc-4e58-94ac-0edff53ef77a admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.936536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1d413-cfdc-4e58-94ac-0edff53ef77a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.938725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 60/126] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:13.945426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9be11b-2891-43bb-8b80-db7006009218 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.956628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9be11b-2891-43bb-8b80-db7006009218 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.962167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1a6b9-5e78-4a97-884e-1477463cf2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.963469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a6b9-5e78-4a97-884e-1477463cf2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.963957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a6b9-5e78-4a97-884e-1477463cf2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.964503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a6b9-5e78-4a97-884e-1477463cf2d2 admin admin] PATH_INFO: `/v3/projects/da9f11a9f3614d1eb83a61ce4af23a43` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.966016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1a6b9-5e78-4a97-884e-1477463cf2d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=da9f11a9f3614d1eb83a61ce4af23a43)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:13.968543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1a6b9-5e78-4a97-884e-1477463cf2d2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:13.970709 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 67/127] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:13 2021] GET /identity/v3/projects/da9f11a9f3614d1eb83a61ce4af23a43 => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:13.978240 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d413-cfdc-4e58-94ac-0edff53ef77a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:13.989551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1d413-cfdc-4e58-94ac-0edff53ef77a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:13.994657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8f4ef-8e89-45db-a0c0-6ca24435fb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:13.995998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8f4ef-8e89-45db-a0c0-6ca24435fb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:13.996634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8f4ef-8e89-45db-a0c0-6ca24435fb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:13.997109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8f4ef-8e89-45db-a0c0-6ca24435fb5e admin admin] PATH_INFO: `/v3/projects/da9f11a9f3614d1eb83a61ce4af23a43/users/2e3f36f5b5f44a18a2db871888e03bd7/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:13.999655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8f4ef-8e89-45db-a0c0-6ca24435fb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9f11a9f3614d1eb83a61ce4af23a43, user_id=2e3f36f5b5f44a18a2db871888e03bd7, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:14.002728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8f4ef-8e89-45db-a0c0-6ca24435fb5e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:14.019651 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 61/128] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:13 2021] PUT /identity/v3/projects/da9f11a9f3614d1eb83a61ce4af23a43/users/2e3f36f5b5f44a18a2db871888e03bd7/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:15.353298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4734a-16c5-4328-ab0b-f658f5e5dc40 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:15.354367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4734a-16c5-4328-ab0b-f658f5e5dc40 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:15.354883 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4734a-16c5-4328-ab0b-f658f5e5dc40 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:15.356864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 68/129] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:15.363247 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5088ba-9324-4628-8c9b-8999ae48e65e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:15.364123 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5088ba-9324-4628-8c9b-8999ae48e65e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:15.365160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5088ba-9324-4628-8c9b-8999ae48e65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:15.387632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-9b5088ba-9324-4628-8c9b-8999ae48e65e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:15.389415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-9b5088ba-9324-4628-8c9b-8999ae48e65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:15.461449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 62/130] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:15.501465 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4734a-16c5-4328-ab0b-f658f5e5dc40 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:15.516214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4734a-16c5-4328-ab0b-f658f5e5dc40 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:15.524675 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e17bac-6fe1-4cbe-8ee6-e86ccfd8b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:15.525818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e17bac-6fe1-4cbe-8ee6-e86ccfd8b791 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:15.526309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e17bac-6fe1-4cbe-8ee6-e86ccfd8b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:15.526821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e17bac-6fe1-4cbe-8ee6-e86ccfd8b791 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:15.542576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e17bac-6fe1-4cbe-8ee6-e86ccfd8b791 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:15.549900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-16e17bac-6fe1-4cbe-8ee6-e86ccfd8b791 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:15.551373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 69/131] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:15.557939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5088ba-9324-4628-8c9b-8999ae48e65e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:15.567256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5088ba-9324-4628-8c9b-8999ae48e65e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:15.574273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15413cb-c768-4f71-a726-5f5ab582691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:15.575225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15413cb-c768-4f71-a726-5f5ab582691f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:15.575730 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15413cb-c768-4f71-a726-5f5ab582691f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:15.576246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15413cb-c768-4f71-a726-5f5ab582691f admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:15.577260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15413cb-c768-4f71-a726-5f5ab582691f admin admin] RBAC: Adding query filter params (name=member) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:15.577768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15413cb-c768-4f71-a726-5f5ab582691f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:15.579604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15413cb-c768-4f71-a726-5f5ab582691f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:15.589547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 63/132] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:15.595488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e17bac-6fe1-4cbe-8ee6-e86ccfd8b791 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:15.606958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e17bac-6fe1-4cbe-8ee6-e86ccfd8b791 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:15.613946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4f9d-8981-4016-94bb-7210c4b110f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:15.615173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4f9d-8981-4016-94bb-7210c4b110f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:15.615701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4f9d-8981-4016-94bb-7210c4b110f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:15.616182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a4f9d-8981-4016-94bb-7210c4b110f6 admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:15.617651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a4f9d-8981-4016-94bb-7210c4b110f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:15.620205 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a4f9d-8981-4016-94bb-7210c4b110f6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:15.622027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 70/133] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:15 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:15.628458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15413cb-c768-4f71-a726-5f5ab582691f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:15.639140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15413cb-c768-4f71-a726-5f5ab582691f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:15.647427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a85af3-9760-4420-a1e7-11d37236f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:15.648347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a85af3-9760-4420-a1e7-11d37236f7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:15.648854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a85af3-9760-4420-a1e7-11d37236f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:15.649398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a85af3-9760-4420-a1e7-11d37236f7c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:15.663321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a85af3-9760-4420-a1e7-11d37236f7c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:15.665498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a85af3-9760-4420-a1e7-11d37236f7c9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:15.678229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 64/134] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:15.684821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4f9d-8981-4016-94bb-7210c4b110f6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:15.695091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a4f9d-8981-4016-94bb-7210c4b110f6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:15.701160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c9c4b-18bb-4982-9579-75be4bb563dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:15.702328 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9c4b-18bb-4982-9579-75be4bb563dd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:15.702894 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9c4b-18bb-4982-9579-75be4bb563dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:15.703366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9c4b-18bb-4982-9579-75be4bb563dd admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:15.704822 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c9c4b-18bb-4982-9579-75be4bb563dd admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:15.707252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c9c4b-18bb-4982-9579-75be4bb563dd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:15.709968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 71/135] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:15 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:15.716513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a85af3-9760-4420-a1e7-11d37236f7c9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:15.726863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a85af3-9760-4420-a1e7-11d37236f7c9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:15.734849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfbcb9-47e3-47e6-ad49-cff22e704d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:15.735815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfbcb9-47e3-47e6-ad49-cff22e704d5d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:15.736308 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfbcb9-47e3-47e6-ad49-cff22e704d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:15.736826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfbcb9-47e3-47e6-ad49-cff22e704d5d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:15.737879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfbcb9-47e3-47e6-ad49-cff22e704d5d admin admin] RBAC: Adding query filter params (role.id=426e730bef7e42f4bb8753fa9312a9c2, scope.project.id=749968f930fa45ba9591e86301e37c6b, user.id=2e3f36f5b5f44a18a2db871888e03bd7) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:15.738417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfbcb9-47e3-47e6-ad49-cff22e704d5d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:15.740619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfbcb9-47e3-47e6-ad49-cff22e704d5d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:15.748256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 65/136] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:15 2021] GET /identity/v3/role_assignments?user.id=2e3f36f5b5f44a18a2db871888e03bd7&scope.project.id=749968f930fa45ba9591e86301e37c6b&role.id=426e730bef7e42f4bb8753fa9312a9c2 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:16.349938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875069-b28a-4e31-a121-3ff62bdc3f6b None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.350653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875069-b28a-4e31-a121-3ff62bdc3f6b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.351212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875069-b28a-4e31-a121-3ff62bdc3f6b None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.353222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 72/137] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:16.359978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e6e79-0e9f-426a-9f64-f84343c14cf6 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.360595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e6e79-0e9f-426a-9f64-f84343c14cf6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.361090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e6e79-0e9f-426a-9f64-f84343c14cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.384167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-044e6e79-0e9f-426a-9f64-f84343c14cf6 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:16.386135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-044e6e79-0e9f-426a-9f64-f84343c14cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:16.396769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 66/138] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:16.434767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462bfc6-e96c-405f-9b28-a4a5ef23c51a None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.435820 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462bfc6-e96c-405f-9b28-a4a5ef23c51a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.436340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462bfc6-e96c-405f-9b28-a4a5ef23c51a None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.438311 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 73/139] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:16.439758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e6e79-0e9f-426a-9f64-f84343c14cf6 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.449746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e6e79-0e9f-426a-9f64-f84343c14cf6 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.451865 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eedeb-c1b2-49c8-851f-63f9340febef None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.452370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eedeb-c1b2-49c8-851f-63f9340febef None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.452854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eedeb-c1b2-49c8-851f-63f9340febef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.477766 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2adae-5bc6-4d3c-9e73-9aa99e2408bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.478953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2adae-5bc6-4d3c-9e73-9aa99e2408bb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.479475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2adae-5bc6-4d3c-9e73-9aa99e2408bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.479957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2adae-5bc6-4d3c-9e73-9aa99e2408bb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.481462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c55eedeb-c1b2-49c8-851f-63f9340febef None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:16.491385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c55eedeb-c1b2-49c8-851f-63f9340febef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:16.509131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2adae-5bc6-4d3c-9e73-9aa99e2408bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:16.511928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 74/140] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 25 01:15:16.519015 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-64d2adae-5bc6-4d3c-9e73-9aa99e2408bb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:16.520624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 67/141] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:16.527381 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eedeb-c1b2-49c8-851f-63f9340febef None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.540861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eedeb-c1b2-49c8-851f-63f9340febef None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.551436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e961b13-3cba-4265-8eb7-daa3cb7832ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.553031 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e961b13-3cba-4265-8eb7-daa3cb7832ba admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.553517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e961b13-3cba-4265-8eb7-daa3cb7832ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.553991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e961b13-3cba-4265-8eb7-daa3cb7832ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.555033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e961b13-3cba-4265-8eb7-daa3cb7832ba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:16.555564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e961b13-3cba-4265-8eb7-daa3cb7832ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:16.557417 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e961b13-3cba-4265-8eb7-daa3cb7832ba admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:16.557855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2adae-5bc6-4d3c-9e73-9aa99e2408bb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.570921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 75/142] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:16.576993 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2adae-5bc6-4d3c-9e73-9aa99e2408bb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.578123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e961b13-3cba-4265-8eb7-daa3cb7832ba admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.581596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8925-4e6c-478a-801e-cae026e15eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.582407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8925-4e6c-478a-801e-cae026e15eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.582706 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8925-4e6c-478a-801e-cae026e15eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.583047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8925-4e6c-478a-801e-cae026e15eb9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.592465 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e961b13-3cba-4265-8eb7-daa3cb7832ba admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.603559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b54cb3-35ee-40a4-a926-5c87065338da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.603728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c8925-4e6c-478a-801e-cae026e15eb9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:16.604910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b54cb3-35ee-40a4-a926-5c87065338da admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.605390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b54cb3-35ee-40a4-a926-5c87065338da admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.605914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b54cb3-35ee-40a4-a926-5c87065338da admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.608098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b54cb3-35ee-40a4-a926-5c87065338da admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:16.610255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b54cb3-35ee-40a4-a926-5c87065338da admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:16.611003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-8f7c8925-4e6c-478a-801e-cae026e15eb9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:16.612212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 68/143] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:16.612635 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 76/144] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:16.619085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8925-4e6c-478a-801e-cae026e15eb9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.620145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b54cb3-35ee-40a4-a926-5c87065338da admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.636921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8925-4e6c-478a-801e-cae026e15eb9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.637443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b54cb3-35ee-40a4-a926-5c87065338da admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.645277 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea6541-bd05-41f0-bdab-8816c3410b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.646765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea6541-bd05-41f0-bdab-8816c3410b8b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.647541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90316605-a58f-4df7-b1f0-da74e530a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.648566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea6541-bd05-41f0-bdab-8816c3410b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.648963 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90316605-a58f-4df7-b1f0-da74e530a254 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.649444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea6541-bd05-41f0-bdab-8816c3410b8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.650536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90316605-a58f-4df7-b1f0-da74e530a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.651130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90316605-a58f-4df7-b1f0-da74e530a254 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.653768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90316605-a58f-4df7-b1f0-da74e530a254 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:16.654293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90316605-a58f-4df7-b1f0-da74e530a254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:16.656179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90316605-a58f-4df7-b1f0-da74e530a254 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:16.666465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 69/145] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:16.670729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea6541-bd05-41f0-bdab-8816c3410b8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:16.670729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea6541-bd05-41f0-bdab-8816c3410b8b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:16.679733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90316605-a58f-4df7-b1f0-da74e530a254 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.684519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 77/146] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:16.690609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea6541-bd05-41f0-bdab-8816c3410b8b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.692048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90316605-a58f-4df7-b1f0-da74e530a254 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.701979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea6541-bd05-41f0-bdab-8816c3410b8b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.703748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb1d73-bfe2-4f16-9a10-9a3e18e822a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.704625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb1d73-bfe2-4f16-9a10-9a3e18e822a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.704911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb1d73-bfe2-4f16-9a10-9a3e18e822a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.705189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb1d73-bfe2-4f16-9a10-9a3e18e822a4 admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.707531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb1d73-bfe2-4f16-9a10-9a3e18e822a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:16.709727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb1d73-bfe2-4f16-9a10-9a3e18e822a4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:16.711535 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 70/147] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:16.714212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0ae4-2561-4d1d-b497-91766624290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.715095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0ae4-2561-4d1d-b497-91766624290c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.715377 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0ae4-2561-4d1d-b497-91766624290c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.715655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c0ae4-2561-4d1d-b497-91766624290c admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.716927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c0ae4-2561-4d1d-b497-91766624290c admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:16.723214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c0ae4-2561-4d1d-b497-91766624290c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:16.725513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 78/148] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:16.728081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb1d73-bfe2-4f16-9a10-9a3e18e822a4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.733791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0ae4-2561-4d1d-b497-91766624290c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.747559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb1d73-bfe2-4f16-9a10-9a3e18e822a4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.754435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ba3d2-93d4-4da2-ad6d-3b6f282bb59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.755164 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ba3d2-93d4-4da2-ad6d-3b6f282bb59e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.755459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ba3d2-93d4-4da2-ad6d-3b6f282bb59e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.755745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ba3d2-93d4-4da2-ad6d-3b6f282bb59e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.759012 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c0ae4-2561-4d1d-b497-91766624290c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.767819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebe882-a202-434a-8aea-c29c88336665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.768473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebe882-a202-434a-8aea-c29c88336665 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.768757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebe882-a202-434a-8aea-c29c88336665 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.769042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebe882-a202-434a-8aea-c29c88336665 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.769878 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebe882-a202-434a-8aea-c29c88336665 admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=749968f930fa45ba9591e86301e37c6b, user.id=3c48fa6914a840d99c4665f7fb9f25b2) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:16.770197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebe882-a202-434a-8aea-c29c88336665 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:16.772129 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebe882-a202-434a-8aea-c29c88336665 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:16.774346 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ba3d2-93d4-4da2-ad6d-3b6f282bb59e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:16.776145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ba3d2-93d4-4da2-ad6d-3b6f282bb59e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:16.783193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 79/149] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/role_assignments?user.id=3c48fa6914a840d99c4665f7fb9f25b2&scope.project.id=749968f930fa45ba9591e86301e37c6b&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:16.789319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 71/150] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:15:16.795840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebe882-a202-434a-8aea-c29c88336665 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.812305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebe882-a202-434a-8aea-c29c88336665 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.817090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e232-ae79-4bc6-a8ab-f221d2a45c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.818024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e232-ae79-4bc6-a8ab-f221d2a45c58 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.818317 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e232-ae79-4bc6-a8ab-f221d2a45c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.818599 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e232-ae79-4bc6-a8ab-f221d2a45c58 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.819988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e232-ae79-4bc6-a8ab-f221d2a45c58 admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:16.822132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e232-ae79-4bc6-a8ab-f221d2a45c58 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:16.832200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 80/151] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:16.838999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ba3d2-93d4-4da2-ad6d-3b6f282bb59e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:16.847963 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ba3d2-93d4-4da2-ad6d-3b6f282bb59e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:16.863626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740cee4-bb42-4ba4-a85b-f8a8713a5154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:16.864831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740cee4-bb42-4ba4-a85b-f8a8713a5154 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:16.865072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740cee4-bb42-4ba4-a85b-f8a8713a5154 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:16.865352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740cee4-bb42-4ba4-a85b-f8a8713a5154 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:16.866195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740cee4-bb42-4ba4-a85b-f8a8713a5154 admin admin] RBAC: Adding query filter params (role.id=b3e69d8143774de5aa40d1fd070a8c03, scope.project.id=749968f930fa45ba9591e86301e37c6b, user.id=2e3f36f5b5f44a18a2db871888e03bd7) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:16.866503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740cee4-bb42-4ba4-a85b-f8a8713a5154 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:16.868387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740cee4-bb42-4ba4-a85b-f8a8713a5154 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:16.875219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 72/152] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:16 2021] GET /identity/v3/role_assignments?user.id=2e3f36f5b5f44a18a2db871888e03bd7&scope.project.id=749968f930fa45ba9591e86301e37c6b&role.id=b3e69d8143774de5aa40d1fd070a8c03 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:17.369814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac01ed-f976-427d-90eb-0e20d0d26a51 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:17.370198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac01ed-f976-427d-90eb-0e20d0d26a51 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:17.370436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac01ed-f976-427d-90eb-0e20d0d26a51 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:17.372627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 81/153] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:17.378824 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b08fb-281f-4078-b516-e29fcbcf7a07 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:17.379124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b08fb-281f-4078-b516-e29fcbcf7a07 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:17.379411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b08fb-281f-4078-b516-e29fcbcf7a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:17.403256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-cd4b08fb-281f-4078-b516-e29fcbcf7a07 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:17.404454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-cd4b08fb-281f-4078-b516-e29fcbcf7a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:17.416015 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 73/154] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:17.462854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac01ed-f976-427d-90eb-0e20d0d26a51 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:17.476597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac01ed-f976-427d-90eb-0e20d0d26a51 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:17.480917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e586a24-20de-47c0-bddc-c09e61d35d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:17.481716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e586a24-20de-47c0-bddc-c09e61d35d43 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:17.481998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e586a24-20de-47c0-bddc-c09e61d35d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:17.482276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e586a24-20de-47c0-bddc-c09e61d35d43 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:17.500735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e586a24-20de-47c0-bddc-c09e61d35d43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:17.508616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-8e586a24-20de-47c0-bddc-c09e61d35d43 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:17.510094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 82/155] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:17.517616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b08fb-281f-4078-b516-e29fcbcf7a07 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:17.532558 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b08fb-281f-4078-b516-e29fcbcf7a07 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:17.541588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11087af2-700a-465f-98b5-14d4ae015cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:17.542586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11087af2-700a-465f-98b5-14d4ae015cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:17.543110 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11087af2-700a-465f-98b5-14d4ae015cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:17.543611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11087af2-700a-465f-98b5-14d4ae015cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:17.544569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11087af2-700a-465f-98b5-14d4ae015cc4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:17.545078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11087af2-700a-465f-98b5-14d4ae015cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:17.546989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11087af2-700a-465f-98b5-14d4ae015cc4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:17.558488 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 74/156] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:17.564951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e586a24-20de-47c0-bddc-c09e61d35d43 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:17.581188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e586a24-20de-47c0-bddc-c09e61d35d43 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:17.586203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18914c3d-7f6e-4623-9087-eb58d7852f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:17.587111 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18914c3d-7f6e-4623-9087-eb58d7852f15 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:17.587393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18914c3d-7f6e-4623-9087-eb58d7852f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:17.587666 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18914c3d-7f6e-4623-9087-eb58d7852f15 admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:17.588861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18914c3d-7f6e-4623-9087-eb58d7852f15 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:17.591091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18914c3d-7f6e-4623-9087-eb58d7852f15 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:17.592897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 83/157] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:17 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:17.599649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11087af2-700a-465f-98b5-14d4ae015cc4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:17.615764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11087af2-700a-465f-98b5-14d4ae015cc4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:17.620392 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a910d66-02d6-4535-bba5-1e9e91cb6854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:17.620999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a910d66-02d6-4535-bba5-1e9e91cb6854 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:17.621285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a910d66-02d6-4535-bba5-1e9e91cb6854 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:17.621564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a910d66-02d6-4535-bba5-1e9e91cb6854 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:17.634363 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a910d66-02d6-4535-bba5-1e9e91cb6854 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:17.636169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a910d66-02d6-4535-bba5-1e9e91cb6854 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:17.649049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 75/158] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:17.655559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18914c3d-7f6e-4623-9087-eb58d7852f15 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:17.667619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18914c3d-7f6e-4623-9087-eb58d7852f15 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:17.672036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b01648-f8c6-43a1-83df-e5fe70d70469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:17.672887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b01648-f8c6-43a1-83df-e5fe70d70469 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:17.673167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b01648-f8c6-43a1-83df-e5fe70d70469 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:17.673438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b01648-f8c6-43a1-83df-e5fe70d70469 admin admin] PATH_INFO: `/v3/projects/da9f11a9f3614d1eb83a61ce4af23a43` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:17.674613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b01648-f8c6-43a1-83df-e5fe70d70469 admin admin] RBAC: Authorizing `identity:get_project(project_id=da9f11a9f3614d1eb83a61ce4af23a43)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:17.676769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b01648-f8c6-43a1-83df-e5fe70d70469 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:17.678425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 84/159] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:17 2021] GET /identity/v3/projects/da9f11a9f3614d1eb83a61ce4af23a43 => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:17.685082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a910d66-02d6-4535-bba5-1e9e91cb6854 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:17.697592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a910d66-02d6-4535-bba5-1e9e91cb6854 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:17.705072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e867ddd-5d9a-4599-a389-c3dac28c3510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:17.706035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e867ddd-5d9a-4599-a389-c3dac28c3510 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:17.706539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e867ddd-5d9a-4599-a389-c3dac28c3510 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:17.707057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e867ddd-5d9a-4599-a389-c3dac28c3510 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:17.708677 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e867ddd-5d9a-4599-a389-c3dac28c3510 admin admin] RBAC: Adding query filter params (role.id=426e730bef7e42f4bb8753fa9312a9c2, scope.project.id=da9f11a9f3614d1eb83a61ce4af23a43, user.id=2e3f36f5b5f44a18a2db871888e03bd7) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:17.709203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e867ddd-5d9a-4599-a389-c3dac28c3510 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:17.711376 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e867ddd-5d9a-4599-a389-c3dac28c3510 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:17.722512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 76/160] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:17 2021] GET /identity/v3/role_assignments?user.id=2e3f36f5b5f44a18a2db871888e03bd7&scope.project.id=da9f11a9f3614d1eb83a61ce4af23a43&role.id=426e730bef7e42f4bb8753fa9312a9c2 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:17.959060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede779c-347e-433c-b81c-9bc1adb7a57d None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:17.959441 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede779c-347e-433c-b81c-9bc1adb7a57d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:17.959652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede779c-347e-433c-b81c-9bc1adb7a57d None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:17.961414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 85/161] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:17.967725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0fe3-effd-4a3e-8561-07613c16e21f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:17.968037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0fe3-effd-4a3e-8561-07613c16e21f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:17.968285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0fe3-effd-4a3e-8561-07613c16e21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:17.991766 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-67ba0fe3-effd-4a3e-8561-07613c16e21f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:17.992984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-67ba0fe3-effd-4a3e-8561-07613c16e21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:18.005520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 77/162] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:18.036564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede779c-347e-433c-b81c-9bc1adb7a57d None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.049512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede779c-347e-433c-b81c-9bc1adb7a57d None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.054365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd399483-e732-48f3-a028-d06fb6d3fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.055202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd399483-e732-48f3-a028-d06fb6d3fb1d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.055457 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd399483-e732-48f3-a028-d06fb6d3fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.055736 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd399483-e732-48f3-a028-d06fb6d3fb1d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.072131 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd399483-e732-48f3-a028-d06fb6d3fb1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:18.079257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-bd399483-e732-48f3-a028-d06fb6d3fb1d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:18.080466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 86/163] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:18.086914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba0fe3-effd-4a3e-8561-07613c16e21f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.097622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba0fe3-effd-4a3e-8561-07613c16e21f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.102603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b04791-073c-40da-8ca9-3ad1ca7d8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.103336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b04791-073c-40da-8ca9-3ad1ca7d8fef admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.103619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b04791-073c-40da-8ca9-3ad1ca7d8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.103898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b04791-073c-40da-8ca9-3ad1ca7d8fef admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.104648 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b04791-073c-40da-8ca9-3ad1ca7d8fef admin admin] RBAC: Adding query filter params (name=member) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:18.104957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b04791-073c-40da-8ca9-3ad1ca7d8fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:18.106647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b04791-073c-40da-8ca9-3ad1ca7d8fef admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:18.116026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 78/164] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:18.122461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd399483-e732-48f3-a028-d06fb6d3fb1d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.134155 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd399483-e732-48f3-a028-d06fb6d3fb1d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.139076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b6cb3-aa79-43dd-bd3b-aaadf3169387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.139986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b6cb3-aa79-43dd-bd3b-aaadf3169387 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.140265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b6cb3-aa79-43dd-bd3b-aaadf3169387 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.140537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b6cb3-aa79-43dd-bd3b-aaadf3169387 admin admin] PATH_INFO: `/v3/users/a1775e58a71b4a74a4ffb567c605e7d2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.162153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b6cb3-aa79-43dd-bd3b-aaadf3169387 admin admin] RBAC: Authorizing `identity:get_user(user_id=a1775e58a71b4a74a4ffb567c605e7d2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:18.164443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b6cb3-aa79-43dd-bd3b-aaadf3169387 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:18.166241 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 87/165] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/users/a1775e58a71b4a74a4ffb567c605e7d2 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:18.172449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b04791-073c-40da-8ca9-3ad1ca7d8fef admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.183316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b04791-073c-40da-8ca9-3ad1ca7d8fef admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.191060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e7ead-1e99-4fda-a79c-d14a37016a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.191806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e7ead-1e99-4fda-a79c-d14a37016a52 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.192088 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e7ead-1e99-4fda-a79c-d14a37016a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.192472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e7ead-1e99-4fda-a79c-d14a37016a52 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.201052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e7ead-1e99-4fda-a79c-d14a37016a52 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:18.202897 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e7ead-1e99-4fda-a79c-d14a37016a52 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:18.212136 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 79/166] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:18.218549 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b6cb3-aa79-43dd-bd3b-aaadf3169387 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.229904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b6cb3-aa79-43dd-bd3b-aaadf3169387 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.234310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14207941-4e68-4193-9404-78a2d7d07aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.235245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14207941-4e68-4193-9404-78a2d7d07aff admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.235533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14207941-4e68-4193-9404-78a2d7d07aff admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.235808 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14207941-4e68-4193-9404-78a2d7d07aff admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.237033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14207941-4e68-4193-9404-78a2d7d07aff admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:18.239854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14207941-4e68-4193-9404-78a2d7d07aff admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:18.241582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 88/167] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:18.248395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e7ead-1e99-4fda-a79c-d14a37016a52 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.257715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e7ead-1e99-4fda-a79c-d14a37016a52 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.263403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667665cd-2866-4d0d-8d20-7ea9b3c892a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.264108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667665cd-2866-4d0d-8d20-7ea9b3c892a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.264393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667665cd-2866-4d0d-8d20-7ea9b3c892a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.264723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667665cd-2866-4d0d-8d20-7ea9b3c892a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.265562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667665cd-2866-4d0d-8d20-7ea9b3c892a9 admin admin] RBAC: Adding query filter params (role.id=426e730bef7e42f4bb8753fa9312a9c2, scope.project.id=73f23529c97d4072a14818ca767c4258, user.id=a1775e58a71b4a74a4ffb567c605e7d2) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:18.265870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667665cd-2866-4d0d-8d20-7ea9b3c892a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:18.267853 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667665cd-2866-4d0d-8d20-7ea9b3c892a9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:18.274017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 80/168] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/role_assignments?user.id=a1775e58a71b4a74a4ffb567c605e7d2&scope.project.id=73f23529c97d4072a14818ca767c4258&role.id=426e730bef7e42f4bb8753fa9312a9c2 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:18.651846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021b7c-a319-488a-8d86-be0ef3922e26 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.652558 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021b7c-a319-488a-8d86-be0ef3922e26 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.652558 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021b7c-a319-488a-8d86-be0ef3922e26 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.654164 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 89/169] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:18.660148 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df98db1-459c-416c-9c6c-573145b79168 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.660649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df98db1-459c-416c-9c6c-573145b79168 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.660805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df98db1-459c-416c-9c6c-573145b79168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.679014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-8df98db1-459c-416c-9c6c-573145b79168 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:18.680194 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8df98db1-459c-416c-9c6c-573145b79168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:18.687686 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 81/170] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:18.712106 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17021b7c-a319-488a-8d86-be0ef3922e26 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.724999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17021b7c-a319-488a-8d86-be0ef3922e26 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.729448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0866078-4ca6-4314-88f6-5fa2769070f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.730262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866078-4ca6-4314-88f6-5fa2769070f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.730553 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866078-4ca6-4314-88f6-5fa2769070f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.730858 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866078-4ca6-4314-88f6-5fa2769070f7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.741331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0866078-4ca6-4314-88f6-5fa2769070f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:18.748149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-a0866078-4ca6-4314-88f6-5fa2769070f7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:18.749382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 90/171] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:18.755982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df98db1-459c-416c-9c6c-573145b79168 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.765651 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df98db1-459c-416c-9c6c-573145b79168 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.770122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb2d2c-0dcc-4bc1-8149-32f40c13bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.771463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb2d2c-0dcc-4bc1-8149-32f40c13bcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.771748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb2d2c-0dcc-4bc1-8149-32f40c13bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.772025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb2d2c-0dcc-4bc1-8149-32f40c13bcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.772773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb2d2c-0dcc-4bc1-8149-32f40c13bcb7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:18.773080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb2d2c-0dcc-4bc1-8149-32f40c13bcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:18.774738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb2d2c-0dcc-4bc1-8149-32f40c13bcb7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:18.783431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 82/172] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:18.789897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0866078-4ca6-4314-88f6-5fa2769070f7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.800712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0866078-4ca6-4314-88f6-5fa2769070f7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.805237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b2997-6b15-4c81-a4a2-998570b25790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.806141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b2997-6b15-4c81-a4a2-998570b25790 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.806426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b2997-6b15-4c81-a4a2-998570b25790 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.806719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b2997-6b15-4c81-a4a2-998570b25790 admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.807948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b2997-6b15-4c81-a4a2-998570b25790 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:18.809874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b2997-6b15-4c81-a4a2-998570b25790 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:18.811743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 91/173] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:18.818361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb2d2c-0dcc-4bc1-8149-32f40c13bcb7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.828643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb2d2c-0dcc-4bc1-8149-32f40c13bcb7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.833903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1117b-7483-468d-9162-10158f7781d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.834549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1117b-7483-468d-9162-10158f7781d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.834861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1117b-7483-468d-9162-10158f7781d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.835142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1117b-7483-468d-9162-10158f7781d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.843585 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1117b-7483-468d-9162-10158f7781d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:18.845373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1117b-7483-468d-9162-10158f7781d0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:18.855606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 83/174] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:18.861965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b2997-6b15-4c81-a4a2-998570b25790 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.872519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b2997-6b15-4c81-a4a2-998570b25790 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.877189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63624f-b641-4680-964c-2b526271da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.878123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63624f-b641-4680-964c-2b526271da11 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.878407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63624f-b641-4680-964c-2b526271da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.878762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63624f-b641-4680-964c-2b526271da11 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.880130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63624f-b641-4680-964c-2b526271da11 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:18.882438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63624f-b641-4680-964c-2b526271da11 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:18.884657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 92/175] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:18.891737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1117b-7483-468d-9162-10158f7781d0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:18.901805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1117b-7483-468d-9162-10158f7781d0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:18.906754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dfea5-aed8-43de-89b6-755f69dfbf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:18.907473 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dfea5-aed8-43de-89b6-755f69dfbf4d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.907755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dfea5-aed8-43de-89b6-755f69dfbf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.908084 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dfea5-aed8-43de-89b6-755f69dfbf4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.909016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637dfea5-aed8-43de-89b6-755f69dfbf4d admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=73f23529c97d4072a14818ca767c4258, user.id=3c48fa6914a840d99c4665f7fb9f25b2) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:18.909374 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637dfea5-aed8-43de-89b6-755f69dfbf4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:18.912007 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637dfea5-aed8-43de-89b6-755f69dfbf4d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:18.918848 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 84/176] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:18 2021] GET /identity/v3/role_assignments?user.id=3c48fa6914a840d99c4665f7fb9f25b2&scope.project.id=73f23529c97d4072a14818ca767c4258&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:18.969382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e318-d50e-44af-a7aa-18d3aab5a6f5 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.969726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e318-d50e-44af-a7aa-18d3aab5a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.969929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e318-d50e-44af-a7aa-18d3aab5a6f5 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.972019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 93/177] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:18.978964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833d9dc-ae25-420b-b18d-cb28247e0990 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:18.979276 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833d9dc-ae25-420b-b18d-cb28247e0990 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:18.979517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833d9dc-ae25-420b-b18d-cb28247e0990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:18.998400 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-4833d9dc-ae25-420b-b18d-cb28247e0990 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:18.999751 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-4833d9dc-ae25-420b-b18d-cb28247e0990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:19.004135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae10e6f-f962-4c59-8e85-d4a19924713c None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:19.004135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae10e6f-f962-4c59-8e85-d4a19924713c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:19.004135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae10e6f-f962-4c59-8e85-d4a19924713c None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:19.004135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 94/178] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:19.007436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 85/179] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:19.012681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6ed06-ed2e-4ffd-a514-a2371965ceeb None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:19.014020 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6ed06-ed2e-4ffd-a514-a2371965ceeb None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:19.014020 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6ed06-ed2e-4ffd-a514-a2371965ceeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:19.031721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833d9dc-ae25-420b-b18d-cb28247e0990 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:19.033975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b4c6ed06-ed2e-4ffd-a514-a2371965ceeb None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:19.035438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b4c6ed06-ed2e-4ffd-a514-a2371965ceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:19.046732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833d9dc-ae25-420b-b18d-cb28247e0990 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:19.048112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 95/180] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:19.052898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065461d-a317-4553-b6dd-edcabedb13ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:19.053784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065461d-a317-4553-b6dd-edcabedb13ce admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:19.054069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065461d-a317-4553-b6dd-edcabedb13ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:19.054342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065461d-a317-4553-b6dd-edcabedb13ce admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:19.055600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065461d-a317-4553-b6dd-edcabedb13ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:19.057334 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065461d-a317-4553-b6dd-edcabedb13ce admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:19.059431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 86/181] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:19.068033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6ed06-ed2e-4ffd-a514-a2371965ceeb None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:19.073474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065461d-a317-4553-b6dd-edcabedb13ce admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:19.078907 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6ed06-ed2e-4ffd-a514-a2371965ceeb None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:19.083451 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065461d-a317-4553-b6dd-edcabedb13ce admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:19.084299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7cb6d-8800-4a30-a37c-7a230b74f94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:19.085192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7cb6d-8800-4a30-a37c-7a230b74f94c admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:19.085653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7cb6d-8800-4a30-a37c-7a230b74f94c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:19.086098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7cb6d-8800-4a30-a37c-7a230b74f94c admin admin] PATH_INFO: `/v3/groups` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:19.087008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7cb6d-8800-4a30-a37c-7a230b74f94c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:19.088216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-2ed7cb6d-8800-4a30-a37c-7a230b74f94c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:19.088216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:19.088216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:19.088435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd0e66-c7c6-4b26-bf69-4f42e32b5a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:19.089283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd0e66-c7c6-4b26-bf69-4f42e32b5a66 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:19.089632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd0e66-c7c6-4b26-bf69-4f42e32b5a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:19.089977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd0e66-c7c6-4b26-bf69-4f42e32b5a66 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:19.090386 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7cb6d-8800-4a30-a37c-7a230b74f94c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:19.103277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd0e66-c7c6-4b26-bf69-4f42e32b5a66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:19.109285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 96/182] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Aug 25 01:15:19 2021] POST /identity/v3/groups => generated 229 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:19.114857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-3acd0e66-c7c6-4b26-bf69-4f42e32b5a66 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:19.114857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 87/183] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:19.119181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7cb6d-8800-4a30-a37c-7a230b74f94c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:19.129868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7cb6d-8800-4a30-a37c-7a230b74f94c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:19.134617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4db343-1c14-4d21-9027-d8bb8f0413a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:19.135328 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4db343-1c14-4d21-9027-d8bb8f0413a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:19.135608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4db343-1c14-4d21-9027-d8bb8f0413a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:19.135878 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4db343-1c14-4d21-9027-d8bb8f0413a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:19.136695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4db343-1c14-4d21-9027-d8bb8f0413a8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:19.136998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4db343-1c14-4d21-9027-d8bb8f0413a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:19.138924 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4db343-1c14-4d21-9027-d8bb8f0413a8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:19.148779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 97/184] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:19.154946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd0e66-c7c6-4b26-bf69-4f42e32b5a66 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:19.166050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd0e66-c7c6-4b26-bf69-4f42e32b5a66 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:19.170664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4594-9219-4c75-b036-91722184a83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:19.171581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4594-9219-4c75-b036-91722184a83f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:19.171860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4594-9219-4c75-b036-91722184a83f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:19.172134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4594-9219-4c75-b036-91722184a83f admin admin] PATH_INFO: `/v3/users/a1775e58a71b4a74a4ffb567c605e7d2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:19.173432 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd4594-9219-4c75-b036-91722184a83f admin admin] RBAC: Authorizing `identity:get_user(user_id=a1775e58a71b4a74a4ffb567c605e7d2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:19.175684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd4594-9219-4c75-b036-91722184a83f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:19.178179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 88/185] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:19 2021] GET /identity/v3/users/a1775e58a71b4a74a4ffb567c605e7d2 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:19.184654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4db343-1c14-4d21-9027-d8bb8f0413a8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:19.195072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4db343-1c14-4d21-9027-d8bb8f0413a8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:19.200289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9489c-648b-43c8-adaa-aba9cd962c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:19.200980 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9489c-648b-43c8-adaa-aba9cd962c09 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:19.201271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9489c-648b-43c8-adaa-aba9cd962c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:19.201540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9489c-648b-43c8-adaa-aba9cd962c09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:19.211498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9489c-648b-43c8-adaa-aba9cd962c09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:19.213349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9489c-648b-43c8-adaa-aba9cd962c09 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:19.224472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 98/186] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:19.230998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4594-9219-4c75-b036-91722184a83f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:19.241106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4594-9219-4c75-b036-91722184a83f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:19.245744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f075a1b-0d93-45c7-bdb5-6c3e8f99a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:19.246655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075a1b-0d93-45c7-bdb5-6c3e8f99a7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:19.247086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075a1b-0d93-45c7-bdb5-6c3e8f99a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:19.247365 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f075a1b-0d93-45c7-bdb5-6c3e8f99a7e4 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:19.248559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f075a1b-0d93-45c7-bdb5-6c3e8f99a7e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:19.250707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f075a1b-0d93-45c7-bdb5-6c3e8f99a7e4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:19.252622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 89/187] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:19 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:19.259348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9489c-648b-43c8-adaa-aba9cd962c09 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:19.268950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9489c-648b-43c8-adaa-aba9cd962c09 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:19.274075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eca13-4a87-400e-a843-b74e268750a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:19.274765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eca13-4a87-400e-a843-b74e268750a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:19.275049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eca13-4a87-400e-a843-b74e268750a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:19.275321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eca13-4a87-400e-a843-b74e268750a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:19.276167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eca13-4a87-400e-a843-b74e268750a9 admin admin] RBAC: Adding query filter params (role.id=b3e69d8143774de5aa40d1fd070a8c03, scope.project.id=73f23529c97d4072a14818ca767c4258, user.id=a1775e58a71b4a74a4ffb567c605e7d2) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:19.276475 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eca13-4a87-400e-a843-b74e268750a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:19.278370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eca13-4a87-400e-a843-b74e268750a9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:19.285290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 99/188] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:19 2021] GET /identity/v3/role_assignments?user.id=a1775e58a71b4a74a4ffb567c605e7d2&scope.project.id=73f23529c97d4072a14818ca767c4258&role.id=b3e69d8143774de5aa40d1fd070a8c03 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:20.455808 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19506a-9592-4295-b5e5-7eb8c483c6c5 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:20.456325 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19506a-9592-4295-b5e5-7eb8c483c6c5 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:20.456325 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19506a-9592-4295-b5e5-7eb8c483c6c5 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:20.458320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 90/189] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:20.464192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8b37a-627c-49b4-999b-062377eed198 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:20.464646 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8b37a-627c-49b4-999b-062377eed198 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:20.464724 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8b37a-627c-49b4-999b-062377eed198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:20.485600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-75b8b37a-627c-49b4-999b-062377eed198 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:20.485600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-75b8b37a-627c-49b4-999b-062377eed198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:20.494741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 100/190] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:20.518183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19506a-9592-4295-b5e5-7eb8c483c6c5 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:20.530517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19506a-9592-4295-b5e5-7eb8c483c6c5 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:20.534992 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46572d-8823-4b98-a8e1-9e78993c1b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:20.535767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46572d-8823-4b98-a8e1-9e78993c1b03 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:20.536569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46572d-8823-4b98-a8e1-9e78993c1b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:20.536846 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46572d-8823-4b98-a8e1-9e78993c1b03 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:20.547098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46572d-8823-4b98-a8e1-9e78993c1b03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:20.553802 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-2e46572d-8823-4b98-a8e1-9e78993c1b03 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:20.554996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 91/191] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:20.561387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8b37a-627c-49b4-999b-062377eed198 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:20.570774 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8b37a-627c-49b4-999b-062377eed198 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:20.575161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f574e-ffed-410e-a7d4-6510a8764860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:20.575811 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f574e-ffed-410e-a7d4-6510a8764860 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:20.576095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f574e-ffed-410e-a7d4-6510a8764860 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:20.576370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f574e-ffed-410e-a7d4-6510a8764860 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:20.577104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f574e-ffed-410e-a7d4-6510a8764860 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:20.577405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f574e-ffed-410e-a7d4-6510a8764860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:20.579017 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f574e-ffed-410e-a7d4-6510a8764860 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:20.587887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 101/192] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:20.593633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46572d-8823-4b98-a8e1-9e78993c1b03 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:20.603383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46572d-8823-4b98-a8e1-9e78993c1b03 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:20.607680 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c563c30-bcee-4979-9e9c-f484f19488e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:20.608530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c563c30-bcee-4979-9e9c-f484f19488e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:20.608811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c563c30-bcee-4979-9e9c-f484f19488e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:20.609080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c563c30-bcee-4979-9e9c-f484f19488e9 admin admin] PATH_INFO: `/v3/users/a1775e58a71b4a74a4ffb567c605e7d2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:20.610250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c563c30-bcee-4979-9e9c-f484f19488e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=a1775e58a71b4a74a4ffb567c605e7d2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:20.612372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c563c30-bcee-4979-9e9c-f484f19488e9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:20.613931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 92/193] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:20 2021] GET /identity/v3/users/a1775e58a71b4a74a4ffb567c605e7d2 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:20.620152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f574e-ffed-410e-a7d4-6510a8764860 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:20.630362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f574e-ffed-410e-a7d4-6510a8764860 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:20.634701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e9f52-36b7-40b2-9fda-b722fb103a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:20.635549 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e9f52-36b7-40b2-9fda-b722fb103a3f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:20.635829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e9f52-36b7-40b2-9fda-b722fb103a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:20.636103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e9f52-36b7-40b2-9fda-b722fb103a3f admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:20.637266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e9f52-36b7-40b2-9fda-b722fb103a3f admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:20.639616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e9f52-36b7-40b2-9fda-b722fb103a3f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:20.641229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 102/194] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:20 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:20.651855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c563c30-bcee-4979-9e9c-f484f19488e9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:20.662107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c563c30-bcee-4979-9e9c-f484f19488e9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:20.666519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154fb72-13ab-4b64-ac0e-d2d67f338e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:20.667414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154fb72-13ab-4b64-ac0e-d2d67f338e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:20.667693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154fb72-13ab-4b64-ac0e-d2d67f338e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:20.667962 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154fb72-13ab-4b64-ac0e-d2d67f338e41 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258/users/a1775e58a71b4a74a4ffb567c605e7d2/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:20.669883 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154fb72-13ab-4b64-ac0e-d2d67f338e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f23529c97d4072a14818ca767c4258, user_id=a1775e58a71b4a74a4ffb567c605e7d2, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:20.672534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154fb72-13ab-4b64-ac0e-d2d67f338e41 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:20.691025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 93/195] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:20 2021] PUT /identity/v3/projects/73f23529c97d4072a14818ca767c4258/users/a1775e58a71b4a74a4ffb567c605e7d2/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:21.104831 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef183749-6c03-4f49-9083-7e030f8c3443 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.105201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef183749-6c03-4f49-9083-7e030f8c3443 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.105401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef183749-6c03-4f49-9083-7e030f8c3443 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.107186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 103/196] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:21.113232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63e6fc-b3ce-45be-ad1d-92b05a17353e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.113525 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63e6fc-b3ce-45be-ad1d-92b05a17353e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.113803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63e6fc-b3ce-45be-ad1d-92b05a17353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.132006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-7b63e6fc-b3ce-45be-ad1d-92b05a17353e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:21.133184 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7b63e6fc-b3ce-45be-ad1d-92b05a17353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:21.195904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 94/197] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:21.219505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef183749-6c03-4f49-9083-7e030f8c3443 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.232596 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef183749-6c03-4f49-9083-7e030f8c3443 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.237095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b3948-5f01-4c00-bb48-376d59a43044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.237967 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b3948-5f01-4c00-bb48-376d59a43044 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.238255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b3948-5f01-4c00-bb48-376d59a43044 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.238590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b3948-5f01-4c00-bb48-376d59a43044 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.249963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b3948-5f01-4c00-bb48-376d59a43044 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:21.256942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-f14b3948-5f01-4c00-bb48-376d59a43044 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:21.258174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 104/198] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:21.264985 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63e6fc-b3ce-45be-ad1d-92b05a17353e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.274180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63e6fc-b3ce-45be-ad1d-92b05a17353e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.278962 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17e8e5-fe0d-42d2-a898-09904489305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.279621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17e8e5-fe0d-42d2-a898-09904489305a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.279909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17e8e5-fe0d-42d2-a898-09904489305a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.280187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17e8e5-fe0d-42d2-a898-09904489305a admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.280939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17e8e5-fe0d-42d2-a898-09904489305a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:21.281302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17e8e5-fe0d-42d2-a898-09904489305a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:21.283003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17e8e5-fe0d-42d2-a898-09904489305a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:21.292476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 95/199] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:21.298612 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b3948-5f01-4c00-bb48-376d59a43044 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.309851 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b3948-5f01-4c00-bb48-376d59a43044 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.314444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32313a61-b2e1-4bfe-a142-1e583e95697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.315346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32313a61-b2e1-4bfe-a142-1e583e95697c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.315684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32313a61-b2e1-4bfe-a142-1e583e95697c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.315965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32313a61-b2e1-4bfe-a142-1e583e95697c admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.317291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32313a61-b2e1-4bfe-a142-1e583e95697c admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:21.319378 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32313a61-b2e1-4bfe-a142-1e583e95697c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:21.321154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 105/200] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:21 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:21.327715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17e8e5-fe0d-42d2-a898-09904489305a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.338860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17e8e5-fe0d-42d2-a898-09904489305a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.343981 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f581-53ae-4811-8b5a-2f7f393c8ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.344943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f581-53ae-4811-8b5a-2f7f393c8ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.345235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f581-53ae-4811-8b5a-2f7f393c8ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.345522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f581-53ae-4811-8b5a-2f7f393c8ad6 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.347032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044f581-53ae-4811-8b5a-2f7f393c8ad6 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:21.350063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044f581-53ae-4811-8b5a-2f7f393c8ad6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:21.352059 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 96/201] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:21 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:21.358976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32313a61-b2e1-4bfe-a142-1e583e95697c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.370265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32313a61-b2e1-4bfe-a142-1e583e95697c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.375137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d54cf-2c13-4b56-9065-72a99a471995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.376108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d54cf-2c13-4b56-9065-72a99a471995 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.376391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d54cf-2c13-4b56-9065-72a99a471995 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.376670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d54cf-2c13-4b56-9065-72a99a471995 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258/users/3c48fa6914a840d99c4665f7fb9f25b2/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.378986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d54cf-2c13-4b56-9065-72a99a471995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f23529c97d4072a14818ca767c4258, user_id=3c48fa6914a840d99c4665f7fb9f25b2, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:21.381914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d54cf-2c13-4b56-9065-72a99a471995 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:21.398690 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 106/202] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:21 2021] PUT /identity/v3/projects/73f23529c97d4072a14818ca767c4258/users/3c48fa6914a840d99c4665f7fb9f25b2/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:21.413281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63820b-0320-4b45-9c0d-6fcd48c173ce None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.413621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63820b-0320-4b45-9c0d-6fcd48c173ce None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.413959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63820b-0320-4b45-9c0d-6fcd48c173ce None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.416388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 97/203] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:21.422755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fc011-1b91-4a6a-8512-d32bd6cacb44 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.423051 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fc011-1b91-4a6a-8512-d32bd6cacb44 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.423331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fc011-1b91-4a6a-8512-d32bd6cacb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.435311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51fb69-5a50-4bad-88bb-a5407640eb14 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.435601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51fb69-5a50-4bad-88bb-a5407640eb14 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.435886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51fb69-5a50-4bad-88bb-a5407640eb14 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.437694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 98/204] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:21.442854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-121fc011-1b91-4a6a-8512-d32bd6cacb44 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:21.444091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-121fc011-1b91-4a6a-8512-d32bd6cacb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:21.444547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd808790-9a79-4fbe-bd99-11206d0cbe41 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.444839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd808790-9a79-4fbe-bd99-11206d0cbe41 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.445126 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd808790-9a79-4fbe-bd99-11206d0cbe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.469481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-fd808790-9a79-4fbe-bd99-11206d0cbe41 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:21.471062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-fd808790-9a79-4fbe-bd99-11206d0cbe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:21.524897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 107/205] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:21.542498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 99/206] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:21.549846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fc011-1b91-4a6a-8512-d32bd6cacb44 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.559327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fc011-1b91-4a6a-8512-d32bd6cacb44 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.563876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3130da6-7556-4443-8e19-05eb0aa456fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.564684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130da6-7556-4443-8e19-05eb0aa456fd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.564964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130da6-7556-4443-8e19-05eb0aa456fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.565238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130da6-7556-4443-8e19-05eb0aa456fd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.566436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3130da6-7556-4443-8e19-05eb0aa456fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:21.568263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3130da6-7556-4443-8e19-05eb0aa456fd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:21.570381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd808790-9a79-4fbe-bd99-11206d0cbe41 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.575055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 108/207] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:21.577492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3130da6-7556-4443-8e19-05eb0aa456fd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.580177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd808790-9a79-4fbe-bd99-11206d0cbe41 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.586736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5eebe1-9b8f-476c-b6a0-eb04c2939692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.587753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eebe1-9b8f-476c-b6a0-eb04c2939692 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.588099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eebe1-9b8f-476c-b6a0-eb04c2939692 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.588197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3130da6-7556-4443-8e19-05eb0aa456fd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.588468 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eebe1-9b8f-476c-b6a0-eb04c2939692 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.593514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa3aa5-4ca0-4893-97dd-7e445596958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.594150 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa3aa5-4ca0-4893-97dd-7e445596958b admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.594432 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa3aa5-4ca0-4893-97dd-7e445596958b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.596000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa3aa5-4ca0-4893-97dd-7e445596958b admin admin] PATH_INFO: `/v3/groups` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.596000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa3aa5-4ca0-4893-97dd-7e445596958b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:21.597757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa3aa5-4ca0-4893-97dd-7e445596958b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:21.601031 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5eebe1-9b8f-476c-b6a0-eb04c2939692 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:21.610107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-1c5eebe1-9b8f-476c-b6a0-eb04c2939692 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:21.611429 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 100/208] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:21.617685 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5eebe1-9b8f-476c-b6a0-eb04c2939692 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.617957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 109/209] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Aug 25 01:15:21 2021] POST /identity/v3/groups => generated 226 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:21.628918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5eebe1-9b8f-476c-b6a0-eb04c2939692 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.633610 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c3a3-3ae6-4841-9840-6e4a359fa6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.634311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c3a3-3ae6-4841-9840-6e4a359fa6da admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.634590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c3a3-3ae6-4841-9840-6e4a359fa6da admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.634923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c3a3-3ae6-4841-9840-6e4a359fa6da admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.636852 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c3a3-3ae6-4841-9840-6e4a359fa6da admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:21.636852 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c3a3-3ae6-4841-9840-6e4a359fa6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:21.637717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c3a3-3ae6-4841-9840-6e4a359fa6da admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:21.650863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 101/210] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:21.657758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa3aa5-4ca0-4893-97dd-7e445596958b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.670528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa3aa5-4ca0-4893-97dd-7e445596958b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.675311 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae24f2b-5898-4a39-8255-f9254f2a84c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.676212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae24f2b-5898-4a39-8255-f9254f2a84c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.676497 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae24f2b-5898-4a39-8255-f9254f2a84c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.676821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae24f2b-5898-4a39-8255-f9254f2a84c1 admin admin] PATH_INFO: `/v3/users/a1775e58a71b4a74a4ffb567c605e7d2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.678121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae24f2b-5898-4a39-8255-f9254f2a84c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=a1775e58a71b4a74a4ffb567c605e7d2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:21.680375 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae24f2b-5898-4a39-8255-f9254f2a84c1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:21.682316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 110/211] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:21 2021] GET /identity/v3/users/a1775e58a71b4a74a4ffb567c605e7d2 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:21.688852 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c3a3-3ae6-4841-9840-6e4a359fa6da admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.699444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c3a3-3ae6-4841-9840-6e4a359fa6da admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.703949 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04e9b7-235b-4f75-8a0d-727c685baa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.704825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04e9b7-235b-4f75-8a0d-727c685baa82 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.705109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04e9b7-235b-4f75-8a0d-727c685baa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.705387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04e9b7-235b-4f75-8a0d-727c685baa82 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.706624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04e9b7-235b-4f75-8a0d-727c685baa82 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:21.709316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04e9b7-235b-4f75-8a0d-727c685baa82 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:21.711554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 102/212] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:21 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:21.717918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae24f2b-5898-4a39-8255-f9254f2a84c1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:21.729064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae24f2b-5898-4a39-8255-f9254f2a84c1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:21.733909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eeba8d-a2fb-4eb3-ace4-517879e8c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:21.734851 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeba8d-a2fb-4eb3-ace4-517879e8c3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:21.735206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeba8d-a2fb-4eb3-ace4-517879e8c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:21.735469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeba8d-a2fb-4eb3-ace4-517879e8c3ab admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258/users/a1775e58a71b4a74a4ffb567c605e7d2/roles/b3e69d8143774de5aa40d1fd070a8c03` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:21.738007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eeba8d-a2fb-4eb3-ace4-517879e8c3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f23529c97d4072a14818ca767c4258, user_id=a1775e58a71b4a74a4ffb567c605e7d2, role_id=b3e69d8143774de5aa40d1fd070a8c03)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:21.741127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eeba8d-a2fb-4eb3-ace4-517879e8c3ab admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:21.758174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 111/213] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:21 2021] PUT /identity/v3/projects/73f23529c97d4072a14818ca767c4258/users/a1775e58a71b4a74a4ffb567c605e7d2/roles/b3e69d8143774de5aa40d1fd070a8c03 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:22.999070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8882-a833-4863-83cc-b52b21c551e8 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:22.999590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8882-a833-4863-83cc-b52b21c551e8 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:22.999590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8882-a833-4863-83cc-b52b21c551e8 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:23.001384 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 103/214] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:23.007371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f2d7-199c-492b-917b-5605f84065e1 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:23.007781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f2d7-199c-492b-917b-5605f84065e1 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:23.007950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f2d7-199c-492b-917b-5605f84065e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:23.032683 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6535f2d7-199c-492b-917b-5605f84065e1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:23.033879 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6535f2d7-199c-492b-917b-5605f84065e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:23.105685 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 112/215] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:23.149068 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8882-a833-4863-83cc-b52b21c551e8 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:23.162759 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8882-a833-4863-83cc-b52b21c551e8 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:23.167482 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1978f-b68f-446a-868b-3d7faa9db505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:23.168316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1978f-b68f-446a-868b-3d7faa9db505 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:23.168601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1978f-b68f-446a-868b-3d7faa9db505 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:23.168919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1978f-b68f-446a-868b-3d7faa9db505 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:23.187659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1978f-b68f-446a-868b-3d7faa9db505 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:23.194768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-74e1978f-b68f-446a-868b-3d7faa9db505 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:23.195995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 104/216] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:23.202444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f2d7-199c-492b-917b-5605f84065e1 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:23.212343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f2d7-199c-492b-917b-5605f84065e1 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:23.218944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce5cc2-de42-4c0b-b15c-aaffa25ab4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:23.219632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce5cc2-de42-4c0b-b15c-aaffa25ab4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:23.219916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce5cc2-de42-4c0b-b15c-aaffa25ab4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:23.220194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce5cc2-de42-4c0b-b15c-aaffa25ab4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:23.220955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce5cc2-de42-4c0b-b15c-aaffa25ab4b5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:23.221264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce5cc2-de42-4c0b-b15c-aaffa25ab4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:23.222906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce5cc2-de42-4c0b-b15c-aaffa25ab4b5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:23.233592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 113/217] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:23.240091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1978f-b68f-446a-868b-3d7faa9db505 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:23.250806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1978f-b68f-446a-868b-3d7faa9db505 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:23.258968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815df881-cee8-4ce3-9316-00cbcfe6de35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:23.259920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815df881-cee8-4ce3-9316-00cbcfe6de35 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:23.260259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815df881-cee8-4ce3-9316-00cbcfe6de35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:23.260541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815df881-cee8-4ce3-9316-00cbcfe6de35 admin admin] PATH_INFO: `/v3/users/a1775e58a71b4a74a4ffb567c605e7d2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:23.261887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815df881-cee8-4ce3-9316-00cbcfe6de35 admin admin] RBAC: Authorizing `identity:get_user(user_id=a1775e58a71b4a74a4ffb567c605e7d2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:23.264505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815df881-cee8-4ce3-9316-00cbcfe6de35 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:23.266277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 105/218] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:23 2021] GET /identity/v3/users/a1775e58a71b4a74a4ffb567c605e7d2 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:23.273142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce5cc2-de42-4c0b-b15c-aaffa25ab4b5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:23.283580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce5cc2-de42-4c0b-b15c-aaffa25ab4b5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:23.290861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc922219-8ca7-42b1-b595-0237b198172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:23.291574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922219-8ca7-42b1-b595-0237b198172d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:23.291859 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922219-8ca7-42b1-b595-0237b198172d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:23.292142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922219-8ca7-42b1-b595-0237b198172d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:23.301301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc922219-8ca7-42b1-b595-0237b198172d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:23.303226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc922219-8ca7-42b1-b595-0237b198172d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:23.318584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 114/219] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:23.325401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815df881-cee8-4ce3-9316-00cbcfe6de35 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:23.336691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815df881-cee8-4ce3-9316-00cbcfe6de35 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:23.343360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacf179-7c72-46dd-a0bf-e536f51a2e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:23.344273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf179-7c72-46dd-a0bf-e536f51a2e98 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:23.344557 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf179-7c72-46dd-a0bf-e536f51a2e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:23.344835 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf179-7c72-46dd-a0bf-e536f51a2e98 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:23.346056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacf179-7c72-46dd-a0bf-e536f51a2e98 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:23.348207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacf179-7c72-46dd-a0bf-e536f51a2e98 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:23.350018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 106/220] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:23 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:23.357083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc922219-8ca7-42b1-b595-0237b198172d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:23.366720 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc922219-8ca7-42b1-b595-0237b198172d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:23.373259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf6517-c0e5-4168-a9a9-4d83d8886ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:23.373977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf6517-c0e5-4168-a9a9-4d83d8886ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:23.374260 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf6517-c0e5-4168-a9a9-4d83d8886ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:23.374588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf6517-c0e5-4168-a9a9-4d83d8886ea5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:23.375551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf6517-c0e5-4168-a9a9-4d83d8886ea5 admin admin] RBAC: Adding query filter params (role.id=426e730bef7e42f4bb8753fa9312a9c2, scope.project.id=73f23529c97d4072a14818ca767c4258, user.id=a1775e58a71b4a74a4ffb567c605e7d2) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:23.375872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf6517-c0e5-4168-a9a9-4d83d8886ea5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:23.377844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf6517-c0e5-4168-a9a9-4d83d8886ea5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:23.385063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 115/221] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:23 2021] GET /identity/v3/role_assignments?user.id=a1775e58a71b4a74a4ffb567c605e7d2&scope.project.id=73f23529c97d4072a14818ca767c4258&role.id=426e730bef7e42f4bb8753fa9312a9c2 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:24.360861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ac69-1568-443c-b6e3-536fb2c2e403 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.361402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ac69-1568-443c-b6e3-536fb2c2e403 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.361402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5ac69-1568-443c-b6e3-536fb2c2e403 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.363256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 107/222] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:24.370144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c67c46-92ce-4926-8fba-1060bbb0d8e9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.370571 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c67c46-92ce-4926-8fba-1060bbb0d8e9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.370780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c67c46-92ce-4926-8fba-1060bbb0d8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.395703 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-85c67c46-92ce-4926-8fba-1060bbb0d8e9 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:24.396897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-85c67c46-92ce-4926-8fba-1060bbb0d8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:24.404638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 116/223] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:24.446006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5ac69-1568-443c-b6e3-536fb2c2e403 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.465226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5ac69-1568-443c-b6e3-536fb2c2e403 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.472434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dc072-65fd-4931-a224-e89ef30e8adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.473249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dc072-65fd-4931-a224-e89ef30e8adb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.474104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dc072-65fd-4931-a224-e89ef30e8adb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.474386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dc072-65fd-4931-a224-e89ef30e8adb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.495284 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dc072-65fd-4931-a224-e89ef30e8adb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:24.502282 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-5f8dc072-65fd-4931-a224-e89ef30e8adb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:24.505976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 108/224] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:24.513087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c67c46-92ce-4926-8fba-1060bbb0d8e9 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.523043 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c67c46-92ce-4926-8fba-1060bbb0d8e9 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.532587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62882d25-823a-48da-9fc7-2f4ea03f7fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.533255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62882d25-823a-48da-9fc7-2f4ea03f7fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.533537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62882d25-823a-48da-9fc7-2f4ea03f7fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.533812 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62882d25-823a-48da-9fc7-2f4ea03f7fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.534562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62882d25-823a-48da-9fc7-2f4ea03f7fb6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:24.534891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62882d25-823a-48da-9fc7-2f4ea03f7fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:24.537076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62882d25-823a-48da-9fc7-2f4ea03f7fb6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:24.545974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 117/225] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:24.552611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dc072-65fd-4931-a224-e89ef30e8adb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.561984 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06249-e2fb-4b56-b3d5-152057f0161b None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.562491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06249-e2fb-4b56-b3d5-152057f0161b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.562797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06249-e2fb-4b56-b3d5-152057f0161b None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.564700 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 118/226] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:24.566637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dc072-65fd-4931-a224-e89ef30e8adb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.570769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7906f7b-4de8-4c01-9153-5bdd7dc25434 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.571058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7906f7b-4de8-4c01-9153-5bdd7dc25434 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.571338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7906f7b-4de8-4c01-9153-5bdd7dc25434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.575040 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11391-a10b-45c3-80b5-eff3c4d1789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.575912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11391-a10b-45c3-80b5-eff3c4d1789a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.576192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11391-a10b-45c3-80b5-eff3c4d1789a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.576469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11391-a10b-45c3-80b5-eff3c4d1789a admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.577664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd11391-a10b-45c3-80b5-eff3c4d1789a admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:24.580826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd11391-a10b-45c3-80b5-eff3c4d1789a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:24.583973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 109/227] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:24.591545 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11391-a10b-45c3-80b5-eff3c4d1789a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.609875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c7906f7b-4de8-4c01-9153-5bdd7dc25434 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:24.613174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c7906f7b-4de8-4c01-9153-5bdd7dc25434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:24.616182 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11391-a10b-45c3-80b5-eff3c4d1789a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.624913 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b660626-cf1e-4fbb-bd40-ce48edbc32cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.625559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b660626-cf1e-4fbb-bd40-ce48edbc32cf admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.625840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b660626-cf1e-4fbb-bd40-ce48edbc32cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.626122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b660626-cf1e-4fbb-bd40-ce48edbc32cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.632803 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 119/228] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:24.638647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b660626-cf1e-4fbb-bd40-ce48edbc32cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:24.640408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b660626-cf1e-4fbb-bd40-ce48edbc32cf admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:24.652106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 110/229] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:24.659106 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7906f7b-4de8-4c01-9153-5bdd7dc25434 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.669437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7906f7b-4de8-4c01-9153-5bdd7dc25434 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.675064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b660626-cf1e-4fbb-bd40-ce48edbc32cf admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.688121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927337e-58aa-4812-a5fb-6be67926330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.689039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927337e-58aa-4812-a5fb-6be67926330e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.689326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927337e-58aa-4812-a5fb-6be67926330e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.689598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927337e-58aa-4812-a5fb-6be67926330e admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.691390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927337e-58aa-4812-a5fb-6be67926330e admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:24.693732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927337e-58aa-4812-a5fb-6be67926330e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:24.697041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b660626-cf1e-4fbb-bd40-ce48edbc32cf admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.698198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 120/230] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:24.702302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66d81b-236a-408e-a26b-2fdf0a241b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.703135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d81b-236a-408e-a26b-2fdf0a241b3c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.703415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d81b-236a-408e-a26b-2fdf0a241b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.703697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d81b-236a-408e-a26b-2fdf0a241b3c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.705469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927337e-58aa-4812-a5fb-6be67926330e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.726246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927337e-58aa-4812-a5fb-6be67926330e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.733791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66d81b-236a-408e-a26b-2fdf0a241b3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:24.737753 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43e43-8021-4546-bcb2-09f3c0c9cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.738448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43e43-8021-4546-bcb2-09f3c0c9cb5c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.743235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43e43-8021-4546-bcb2-09f3c0c9cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.745094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43e43-8021-4546-bcb2-09f3c0c9cb5c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.745949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43e43-8021-4546-bcb2-09f3c0c9cb5c admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=73f23529c97d4072a14818ca767c4258, user.id=3c48fa6914a840d99c4665f7fb9f25b2) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:24.746271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43e43-8021-4546-bcb2-09f3c0c9cb5c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:24.750230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43e43-8021-4546-bcb2-09f3c0c9cb5c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:24.752676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-bb66d81b-236a-408e-a26b-2fdf0a241b3c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:24.759706 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 111/231] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:24.764733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 121/232] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/role_assignments?user.id=3c48fa6914a840d99c4665f7fb9f25b2&scope.project.id=73f23529c97d4072a14818ca767c4258&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 608 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:24.766325 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66d81b-236a-408e-a26b-2fdf0a241b3c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.780022 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66d81b-236a-408e-a26b-2fdf0a241b3c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.785174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3673fe9-3997-42ba-8033-8572a3c6230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.785951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3673fe9-3997-42ba-8033-8572a3c6230d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.786841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3673fe9-3997-42ba-8033-8572a3c6230d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.787125 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3673fe9-3997-42ba-8033-8572a3c6230d admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.788003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3673fe9-3997-42ba-8033-8572a3c6230d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:24.788318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3673fe9-3997-42ba-8033-8572a3c6230d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:24.790034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3673fe9-3997-42ba-8033-8572a3c6230d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:24.803842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 112/233] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:24.810227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43e43-8021-4546-bcb2-09f3c0c9cb5c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.821558 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43e43-8021-4546-bcb2-09f3c0c9cb5c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.832735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042632a-5859-4bc8-bad1-0039347b69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.834187 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042632a-5859-4bc8-bad1-0039347b69e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.834466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042632a-5859-4bc8-bad1-0039347b69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.834800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042632a-5859-4bc8-bad1-0039347b69e9 admin admin] PATH_INFO: `/v3/users/a1775e58a71b4a74a4ffb567c605e7d2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.839636 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042632a-5859-4bc8-bad1-0039347b69e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=a1775e58a71b4a74a4ffb567c605e7d2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:24.841802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042632a-5859-4bc8-bad1-0039347b69e9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:24.843847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 122/234] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/users/a1775e58a71b4a74a4ffb567c605e7d2 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:24.850469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3673fe9-3997-42ba-8033-8572a3c6230d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.864335 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3673fe9-3997-42ba-8033-8572a3c6230d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.870610 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cbd83-8d53-4409-865d-f143b03ad708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.871353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cbd83-8d53-4409-865d-f143b03ad708 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.871731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cbd83-8d53-4409-865d-f143b03ad708 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.872010 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cbd83-8d53-4409-865d-f143b03ad708 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.889705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cbd83-8d53-4409-865d-f143b03ad708 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:24.891656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cbd83-8d53-4409-865d-f143b03ad708 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:24.905532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 113/235] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:24.912519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042632a-5859-4bc8-bad1-0039347b69e9 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.932054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042632a-5859-4bc8-bad1-0039347b69e9 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.945156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a98099-9d60-44be-9456-2dd48813965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.946036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a98099-9d60-44be-9456-2dd48813965f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.946318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a98099-9d60-44be-9456-2dd48813965f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.946591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a98099-9d60-44be-9456-2dd48813965f admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.947853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a98099-9d60-44be-9456-2dd48813965f admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:24.949905 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a98099-9d60-44be-9456-2dd48813965f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:24.951876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 123/236] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:24.959137 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cbd83-8d53-4409-865d-f143b03ad708 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:24.971439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cbd83-8d53-4409-865d-f143b03ad708 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:24.978980 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352de24a-d35b-4f7c-9229-04dcf00a3b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:24.979708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de24a-d35b-4f7c-9229-04dcf00a3b7c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:24.979995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de24a-d35b-4f7c-9229-04dcf00a3b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:24.980270 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352de24a-d35b-4f7c-9229-04dcf00a3b7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:24.981235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352de24a-d35b-4f7c-9229-04dcf00a3b7c admin admin] RBAC: Adding query filter params (role.id=b3e69d8143774de5aa40d1fd070a8c03, scope.project.id=73f23529c97d4072a14818ca767c4258, user.id=a1775e58a71b4a74a4ffb567c605e7d2) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:24.981547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352de24a-d35b-4f7c-9229-04dcf00a3b7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:24.983534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352de24a-d35b-4f7c-9229-04dcf00a3b7c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:24.996047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 114/237] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:24 2021] GET /identity/v3/role_assignments?user.id=a1775e58a71b4a74a4ffb567c605e7d2&scope.project.id=73f23529c97d4072a14818ca767c4258&role.id=b3e69d8143774de5aa40d1fd070a8c03 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:25.029565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04742245-9871-440d-b826-b5f22bb910a5 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.029907 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04742245-9871-440d-b826-b5f22bb910a5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.030121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04742245-9871-440d-b826-b5f22bb910a5 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.032262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 124/238] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:25.045297 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf52d5-32a5-4576-8975-1c3e66cbf6cf None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.045618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf52d5-32a5-4576-8975-1c3e66cbf6cf None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.045849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf52d5-32a5-4576-8975-1c3e66cbf6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.074783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-02bf52d5-32a5-4576-8975-1c3e66cbf6cf None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:25.076035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-02bf52d5-32a5-4576-8975-1c3e66cbf6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:25.091257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 115/239] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:25.133142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04742245-9871-440d-b826-b5f22bb910a5 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.155551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04742245-9871-440d-b826-b5f22bb910a5 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.160248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f48c77-9101-4ad9-a3d5-3d3119c2d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.161104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f48c77-9101-4ad9-a3d5-3d3119c2d9ca admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.161382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f48c77-9101-4ad9-a3d5-3d3119c2d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.161652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f48c77-9101-4ad9-a3d5-3d3119c2d9ca admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.179789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f48c77-9101-4ad9-a3d5-3d3119c2d9ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:25.186647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-67f48c77-9101-4ad9-a3d5-3d3119c2d9ca admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:25.188201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 125/240] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:25.195048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf52d5-32a5-4576-8975-1c3e66cbf6cf None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.208476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf52d5-32a5-4576-8975-1c3e66cbf6cf None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.214026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aa0aa-f3bd-4773-8988-33545cd2578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.214716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aa0aa-f3bd-4773-8988-33545cd2578c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.215006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aa0aa-f3bd-4773-8988-33545cd2578c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.215284 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52aa0aa-f3bd-4773-8988-33545cd2578c admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.216049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aa0aa-f3bd-4773-8988-33545cd2578c admin admin] RBAC: Adding query filter params (name=member) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:25.216358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aa0aa-f3bd-4773-8988-33545cd2578c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:25.218022 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52aa0aa-f3bd-4773-8988-33545cd2578c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:25.230659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 116/241] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:25.236910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f48c77-9101-4ad9-a3d5-3d3119c2d9ca admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.252928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f48c77-9101-4ad9-a3d5-3d3119c2d9ca admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.259704 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb725dfe-df91-4d07-8e21-3c95b552af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.260372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb725dfe-df91-4d07-8e21-3c95b552af23 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.260653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb725dfe-df91-4d07-8e21-3c95b552af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.260927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb725dfe-df91-4d07-8e21-3c95b552af23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.275405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb725dfe-df91-4d07-8e21-3c95b552af23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:25.277221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb725dfe-df91-4d07-8e21-3c95b552af23 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:25.292940 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 126/242] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:25.299503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aa0aa-f3bd-4773-8988-33545cd2578c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.316265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52aa0aa-f3bd-4773-8988-33545cd2578c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.323408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118b277-be48-48c5-9ad3-49070d942b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.324342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b277-be48-48c5-9ad3-49070d942b4e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.324624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b277-be48-48c5-9ad3-49070d942b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.324900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b277-be48-48c5-9ad3-49070d942b4e admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.328111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118b277-be48-48c5-9ad3-49070d942b4e admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:25.330300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118b277-be48-48c5-9ad3-49070d942b4e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:25.332173 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 117/243] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:25.338549 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb725dfe-df91-4d07-8e21-3c95b552af23 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.350377 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb725dfe-df91-4d07-8e21-3c95b552af23 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.358776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cc37e-7270-40df-8c5e-969b76a96ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.359642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cc37e-7270-40df-8c5e-969b76a96ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.359923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cc37e-7270-40df-8c5e-969b76a96ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.360195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cc37e-7270-40df-8c5e-969b76a96ef3 admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.373066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cc37e-7270-40df-8c5e-969b76a96ef3 admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:25.374092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-838cc37e-7270-40df-8c5e-969b76a96ef3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:25.374092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:25.374092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:25.375316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cc37e-7270-40df-8c5e-969b76a96ef3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:25.377018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 127/244] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:25.385182 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118b277-be48-48c5-9ad3-49070d942b4e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.396852 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118b277-be48-48c5-9ad3-49070d942b4e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.400965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b21be-6b04-41c4-9c8a-3255e2825b2e None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.401190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b21be-6b04-41c4-9c8a-3255e2825b2e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.401451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b21be-6b04-41c4-9c8a-3255e2825b2e None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.402843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90247135-29eb-4fa4-852c-a18e64f0ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.403364 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 128/245] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:25.403598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90247135-29eb-4fa4-852c-a18e64f0ba8d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.403891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90247135-29eb-4fa4-852c-a18e64f0ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.404168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90247135-29eb-4fa4-852c-a18e64f0ba8d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.405113 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90247135-29eb-4fa4-852c-a18e64f0ba8d admin admin] RBAC: Adding query filter params (group.id=e538691385fd4b95a990ca4bbe39151c, role.id=426e730bef7e42f4bb8753fa9312a9c2, scope.project.id=749968f930fa45ba9591e86301e37c6b) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:25.405370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90247135-29eb-4fa4-852c-a18e64f0ba8d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:25.407394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90247135-29eb-4fa4-852c-a18e64f0ba8d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:25.411631 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8a1ec-515c-4595-ae53-a6fbfe4b5e47 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.411917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8a1ec-515c-4595-ae53-a6fbfe4b5e47 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.412193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8a1ec-515c-4595-ae53-a6fbfe4b5e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.419231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 118/246] 10.222.0.23 () {56 vars in 1398 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/role_assignments?group.id=e538691385fd4b95a990ca4bbe39151c&scope.project.id=749968f930fa45ba9591e86301e37c6b&role.id=426e730bef7e42f4bb8753fa9312a9c2 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:25.443729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-92e8a1ec-515c-4595-ae53-a6fbfe4b5e47 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:25.444941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-92e8a1ec-515c-4595-ae53-a6fbfe4b5e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:25.455583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 129/247] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:25.514512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90247135-29eb-4fa4-852c-a18e64f0ba8d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.526953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90247135-29eb-4fa4-852c-a18e64f0ba8d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.532873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e47ef-a099-452a-ba4d-e277dd2cabe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.533748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e47ef-a099-452a-ba4d-e277dd2cabe4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.534061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e47ef-a099-452a-ba4d-e277dd2cabe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.534351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e47ef-a099-452a-ba4d-e277dd2cabe4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.549898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e47ef-a099-452a-ba4d-e277dd2cabe4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:25.558103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-131e47ef-a099-452a-ba4d-e277dd2cabe4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:25.559392 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 119/248] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:25.566511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8a1ec-515c-4595-ae53-a6fbfe4b5e47 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.579836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8a1ec-515c-4595-ae53-a6fbfe4b5e47 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.588726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e37b-4d10-490f-8e0d-b980d2ab5892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.589405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e37b-4d10-490f-8e0d-b980d2ab5892 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.589687 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e37b-4d10-490f-8e0d-b980d2ab5892 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.589963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e37b-4d10-490f-8e0d-b980d2ab5892 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.590746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e37b-4d10-490f-8e0d-b980d2ab5892 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:25.591055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e37b-4d10-490f-8e0d-b980d2ab5892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:25.592657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e37b-4d10-490f-8e0d-b980d2ab5892 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:25.606946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 130/249] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:25.613655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e47ef-a099-452a-ba4d-e277dd2cabe4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.627723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e47ef-a099-452a-ba4d-e277dd2cabe4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.635078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f7534-bfe2-4a20-acf5-e6212a0dc3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.635812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f7534-bfe2-4a20-acf5-e6212a0dc3ad admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.636092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f7534-bfe2-4a20-acf5-e6212a0dc3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.636370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f7534-bfe2-4a20-acf5-e6212a0dc3ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.653113 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f7534-bfe2-4a20-acf5-e6212a0dc3ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:25.654988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f7534-bfe2-4a20-acf5-e6212a0dc3ad admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:25.667063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 120/250] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:25.673992 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e37b-4d10-490f-8e0d-b980d2ab5892 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.687576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e37b-4d10-490f-8e0d-b980d2ab5892 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.692006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667b45e-379d-4b70-aae4-8cd020864780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.695136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667b45e-379d-4b70-aae4-8cd020864780 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.695419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667b45e-379d-4b70-aae4-8cd020864780 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.695688 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667b45e-379d-4b70-aae4-8cd020864780 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.697651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667b45e-379d-4b70-aae4-8cd020864780 admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:25.699758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667b45e-379d-4b70-aae4-8cd020864780 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:25.701732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 131/251] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:25.707915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f7534-bfe2-4a20-acf5-e6212a0dc3ad admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.719707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f7534-bfe2-4a20-acf5-e6212a0dc3ad admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.727226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc77f5-3be2-4fd1-95e3-5fdb08c564c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.728081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc77f5-3be2-4fd1-95e3-5fdb08c564c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.728374 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc77f5-3be2-4fd1-95e3-5fdb08c564c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.728651 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc77f5-3be2-4fd1-95e3-5fdb08c564c8 admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.735416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc77f5-3be2-4fd1-95e3-5fdb08c564c8 admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:25.736444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-07fc77f5-3be2-4fd1-95e3-5fdb08c564c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:25.736444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:25.736444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:25.737638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc77f5-3be2-4fd1-95e3-5fdb08c564c8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:25.739873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 121/252] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:25.746608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667b45e-379d-4b70-aae4-8cd020864780 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:25.760339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667b45e-379d-4b70-aae4-8cd020864780 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:25.766891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528f1a6-f064-4c74-9d3f-8f8f91ad4f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:25.767603 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528f1a6-f064-4c74-9d3f-8f8f91ad4f1a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:25.767922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528f1a6-f064-4c74-9d3f-8f8f91ad4f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:25.768281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528f1a6-f064-4c74-9d3f-8f8f91ad4f1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:25.769169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528f1a6-f064-4c74-9d3f-8f8f91ad4f1a admin admin] RBAC: Adding query filter params (group.id=e538691385fd4b95a990ca4bbe39151c, role.id=b3e69d8143774de5aa40d1fd070a8c03, scope.project.id=749968f930fa45ba9591e86301e37c6b) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:25.769475 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528f1a6-f064-4c74-9d3f-8f8f91ad4f1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:25.771489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528f1a6-f064-4c74-9d3f-8f8f91ad4f1a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:25.779188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 132/253] 10.222.0.23 () {56 vars in 1398 bytes} [Wed Aug 25 01:15:25 2021] GET /identity/v3/role_assignments?group.id=e538691385fd4b95a990ca4bbe39151c&scope.project.id=749968f930fa45ba9591e86301e37c6b&role.id=b3e69d8143774de5aa40d1fd070a8c03 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:26.528949 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf6f3-09ef-4a50-b2e8-7c72fd9f587a None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:26.529575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf6f3-09ef-4a50-b2e8-7c72fd9f587a None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:26.529575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf6f3-09ef-4a50-b2e8-7c72fd9f587a None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:26.531465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 122/254] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:26.538121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e192-5ebd-437f-95b5-fcc6304bcad3 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:26.538710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e192-5ebd-437f-95b5-fcc6304bcad3 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:26.538710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e192-5ebd-437f-95b5-fcc6304bcad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:26.563669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d2c3e192-5ebd-437f-95b5-fcc6304bcad3 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:26.564874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d2c3e192-5ebd-437f-95b5-fcc6304bcad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:26.576443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 133/255] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:26.623140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf6f3-09ef-4a50-b2e8-7c72fd9f587a None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:26.640787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf6f3-09ef-4a50-b2e8-7c72fd9f587a None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:26.651305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b9784-042e-4d62-8b39-2a9ca7ac6c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:26.652107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b9784-042e-4d62-8b39-2a9ca7ac6c2d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:26.652377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b9784-042e-4d62-8b39-2a9ca7ac6c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:26.652656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b9784-042e-4d62-8b39-2a9ca7ac6c2d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:26.663520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b9784-042e-4d62-8b39-2a9ca7ac6c2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:26.670436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-565b9784-042e-4d62-8b39-2a9ca7ac6c2d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:26.677015 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 123/256] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:26.678370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3e192-5ebd-437f-95b5-fcc6304bcad3 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:26.687445 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3e192-5ebd-437f-95b5-fcc6304bcad3 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:26.695207 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58cd3a-cc87-4c11-8a84-441b18179460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:26.695880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58cd3a-cc87-4c11-8a84-441b18179460 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:26.696166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58cd3a-cc87-4c11-8a84-441b18179460 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:26.696448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58cd3a-cc87-4c11-8a84-441b18179460 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:26.697202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58cd3a-cc87-4c11-8a84-441b18179460 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:26.697510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58cd3a-cc87-4c11-8a84-441b18179460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:26.699142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58cd3a-cc87-4c11-8a84-441b18179460 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:26.715006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 134/257] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:26.721117 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b9784-042e-4d62-8b39-2a9ca7ac6c2d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:26.733872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b9784-042e-4d62-8b39-2a9ca7ac6c2d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:26.739802 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be38873-d704-4f49-ad03-5aaec74aa755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:26.740450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be38873-d704-4f49-ad03-5aaec74aa755 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:26.740731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be38873-d704-4f49-ad03-5aaec74aa755 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:26.741013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be38873-d704-4f49-ad03-5aaec74aa755 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:26.751386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be38873-d704-4f49-ad03-5aaec74aa755 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:26.753144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be38873-d704-4f49-ad03-5aaec74aa755 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:26.764115 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 124/258] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:26.770494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58cd3a-cc87-4c11-8a84-441b18179460 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:26.783773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58cd3a-cc87-4c11-8a84-441b18179460 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:26.788383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d7747-042b-4867-9c2c-36ee28e8ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:26.789232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d7747-042b-4867-9c2c-36ee28e8ef34 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:26.789511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d7747-042b-4867-9c2c-36ee28e8ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:26.789785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d7747-042b-4867-9c2c-36ee28e8ef34 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:26.795542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d7747-042b-4867-9c2c-36ee28e8ef34 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:26.797638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d7747-042b-4867-9c2c-36ee28e8ef34 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:26.799379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 135/259] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:26 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:26.806590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be38873-d704-4f49-ad03-5aaec74aa755 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:26.815703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be38873-d704-4f49-ad03-5aaec74aa755 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:26.822865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad00366-9c46-4485-b13a-3100b0992508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:26.823769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad00366-9c46-4485-b13a-3100b0992508 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:26.824052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad00366-9c46-4485-b13a-3100b0992508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:26.824326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad00366-9c46-4485-b13a-3100b0992508 admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:26.825552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad00366-9c46-4485-b13a-3100b0992508 admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:26.829373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad00366-9c46-4485-b13a-3100b0992508 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:26.831030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 125/260] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:26 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:26.837805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d7747-042b-4867-9c2c-36ee28e8ef34 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:26.851758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d7747-042b-4867-9c2c-36ee28e8ef34 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:26.861126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c391ae-28b5-4a15-8f95-ac55847c6981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:26.861783 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c391ae-28b5-4a15-8f95-ac55847c6981 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:26.862064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c391ae-28b5-4a15-8f95-ac55847c6981 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:26.862337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c391ae-28b5-4a15-8f95-ac55847c6981 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:26.863231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c391ae-28b5-4a15-8f95-ac55847c6981 admin admin] RBAC: Adding query filter params (group.id=e538691385fd4b95a990ca4bbe39151c, role.id=426e730bef7e42f4bb8753fa9312a9c2, scope.project.id=73f23529c97d4072a14818ca767c4258) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:26.863540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c391ae-28b5-4a15-8f95-ac55847c6981 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:26.865896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c391ae-28b5-4a15-8f95-ac55847c6981 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:26.875136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 136/261] 10.222.0.23 () {56 vars in 1398 bytes} [Wed Aug 25 01:15:26 2021] GET /identity/v3/role_assignments?group.id=e538691385fd4b95a990ca4bbe39151c&scope.project.id=73f23529c97d4072a14818ca767c4258&role.id=426e730bef7e42f4bb8753fa9312a9c2 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:27.170964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc4278-6f61-4717-b7f7-a0058aaf30c6 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.171346 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc4278-6f61-4717-b7f7-a0058aaf30c6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.171524 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc4278-6f61-4717-b7f7-a0058aaf30c6 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.173268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 126/262] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:27.180185 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251116-d0b5-4416-9859-4d6872048520 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.180569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251116-d0b5-4416-9859-4d6872048520 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.180734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251116-d0b5-4416-9859-4d6872048520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.203224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-87251116-d0b5-4416-9859-4d6872048520 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:27.204435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-87251116-d0b5-4416-9859-4d6872048520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:27.215113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 137/263] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:27.241677 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc4278-6f61-4717-b7f7-a0058aaf30c6 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.253961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc4278-6f61-4717-b7f7-a0058aaf30c6 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.260167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c311-bf4f-4ee8-8b3a-4cae3d23b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.260948 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c311-bf4f-4ee8-8b3a-4cae3d23b5fc admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.261225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c311-bf4f-4ee8-8b3a-4cae3d23b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.261495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c311-bf4f-4ee8-8b3a-4cae3d23b5fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.279018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72c311-bf4f-4ee8-8b3a-4cae3d23b5fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:27.285814 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-8a72c311-bf4f-4ee8-8b3a-4cae3d23b5fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:27.287582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 127/264] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:27.294085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251116-d0b5-4416-9859-4d6872048520 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.303788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251116-d0b5-4416-9859-4d6872048520 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.310781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320431b-d6e6-4a5e-b4ce-b9b7824f149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.311456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320431b-d6e6-4a5e-b4ce-b9b7824f149c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.311738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320431b-d6e6-4a5e-b4ce-b9b7824f149c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.312014 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320431b-d6e6-4a5e-b4ce-b9b7824f149c admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.312762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320431b-d6e6-4a5e-b4ce-b9b7824f149c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:27.313076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320431b-d6e6-4a5e-b4ce-b9b7824f149c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:27.314664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320431b-d6e6-4a5e-b4ce-b9b7824f149c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:27.326590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 138/265] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:27.332646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c311-bf4f-4ee8-8b3a-4cae3d23b5fc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.344026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c311-bf4f-4ee8-8b3a-4cae3d23b5fc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.354747 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81736e3b-3da1-424a-baa2-1443211b8ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.355406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81736e3b-3da1-424a-baa2-1443211b8ced admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.355690 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81736e3b-3da1-424a-baa2-1443211b8ced admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.355970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81736e3b-3da1-424a-baa2-1443211b8ced admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.371814 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81736e3b-3da1-424a-baa2-1443211b8ced admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:27.373594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81736e3b-3da1-424a-baa2-1443211b8ced admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:27.384444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 128/266] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:27.391391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320431b-d6e6-4a5e-b4ce-b9b7824f149c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.403635 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320431b-d6e6-4a5e-b4ce-b9b7824f149c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.408120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16425a5d-9594-46fd-9a5f-4af8c27fd02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.408976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16425a5d-9594-46fd-9a5f-4af8c27fd02a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.409254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16425a5d-9594-46fd-9a5f-4af8c27fd02a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.409529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16425a5d-9594-46fd-9a5f-4af8c27fd02a admin admin] PATH_INFO: `/v3/projects/220c843aa1514b7390df45e1ecd50d12` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.415448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16425a5d-9594-46fd-9a5f-4af8c27fd02a admin admin] RBAC: Authorizing `identity:get_project(project_id=220c843aa1514b7390df45e1ecd50d12)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:27.417278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16425a5d-9594-46fd-9a5f-4af8c27fd02a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:27.419353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 139/267] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/projects/220c843aa1514b7390df45e1ecd50d12 => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:27.425579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81736e3b-3da1-424a-baa2-1443211b8ced admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.437271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81736e3b-3da1-424a-baa2-1443211b8ced admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.441878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b5e1d-8b6b-414f-b865-9d125dba172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.442784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b5e1d-8b6b-414f-b865-9d125dba172c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.443067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b5e1d-8b6b-414f-b865-9d125dba172c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.443337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b5e1d-8b6b-414f-b865-9d125dba172c admin admin] PATH_INFO: `/v3/groups/c2ea8813233748a7a4c6b8cd8707caee` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.452866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b5e1d-8b6b-414f-b865-9d125dba172c admin admin] RBAC: Authorizing `identity:get_group(group_id=c2ea8813233748a7a4c6b8cd8707caee)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:27.454786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b5e1d-8b6b-414f-b865-9d125dba172c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:27.456777 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 129/268] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/groups/c2ea8813233748a7a4c6b8cd8707caee => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:27.463384 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16425a5d-9594-46fd-9a5f-4af8c27fd02a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.474441 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16425a5d-9594-46fd-9a5f-4af8c27fd02a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.487735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6fa06-f8cc-42f9-b728-bdd6b6189fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.487735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6fa06-f8cc-42f9-b728-bdd6b6189fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.487735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6fa06-f8cc-42f9-b728-bdd6b6189fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.487735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6fa06-f8cc-42f9-b728-bdd6b6189fd7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.488477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6fa06-f8cc-42f9-b728-bdd6b6189fd7 admin admin] RBAC: Adding query filter params (group.id=c2ea8813233748a7a4c6b8cd8707caee, role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=220c843aa1514b7390df45e1ecd50d12) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:27.488477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6fa06-f8cc-42f9-b728-bdd6b6189fd7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:27.488477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6fa06-f8cc-42f9-b728-bdd6b6189fd7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:27.499153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 140/269] 10.222.0.23 () {56 vars in 1398 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/role_assignments?group.id=c2ea8813233748a7a4c6b8cd8707caee&scope.project.id=220c843aa1514b7390df45e1ecd50d12&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:27.599690 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7a2be-930a-4b9b-ae72-a3a46a7ca29c None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.600360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7a2be-930a-4b9b-ae72-a3a46a7ca29c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.600360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7a2be-930a-4b9b-ae72-a3a46a7ca29c None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.602056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 130/270] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:27.609873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01eec5a-36a6-4055-941e-94b9bdcb05d1 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.610580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01eec5a-36a6-4055-941e-94b9bdcb05d1 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.610580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01eec5a-36a6-4055-941e-94b9bdcb05d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.630250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-f01eec5a-36a6-4055-941e-94b9bdcb05d1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:27.631559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f01eec5a-36a6-4055-941e-94b9bdcb05d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:27.646789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 141/271] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:27.666426 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7a2be-930a-4b9b-ae72-a3a46a7ca29c None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.679274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7a2be-930a-4b9b-ae72-a3a46a7ca29c None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.683572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64ffc7-249e-4a4f-b1e9-3ea0d487ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.684372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64ffc7-249e-4a4f-b1e9-3ea0d487ed77 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.684656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64ffc7-249e-4a4f-b1e9-3ea0d487ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.684932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64ffc7-249e-4a4f-b1e9-3ea0d487ed77 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.697670 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64ffc7-249e-4a4f-b1e9-3ea0d487ed77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:27.705051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-7b64ffc7-249e-4a4f-b1e9-3ea0d487ed77 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:27.706293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 131/272] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:27.713430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01eec5a-36a6-4055-941e-94b9bdcb05d1 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.723023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01eec5a-36a6-4055-941e-94b9bdcb05d1 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.728234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8091-cf74-43fe-b158-d4be8113e744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.728913 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8091-cf74-43fe-b158-d4be8113e744 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.729246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8091-cf74-43fe-b158-d4be8113e744 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.729528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8091-cf74-43fe-b158-d4be8113e744 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.730284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f8091-cf74-43fe-b158-d4be8113e744 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:27.730589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f8091-cf74-43fe-b158-d4be8113e744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:27.732224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f8091-cf74-43fe-b158-d4be8113e744 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:27.743773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 142/273] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:27.750198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64ffc7-249e-4a4f-b1e9-3ea0d487ed77 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.760803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64ffc7-249e-4a4f-b1e9-3ea0d487ed77 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.765634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea0622-1dbd-4e91-b46c-53009c87fbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.766296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea0622-1dbd-4e91-b46c-53009c87fbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.766578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea0622-1dbd-4e91-b46c-53009c87fbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.766894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea0622-1dbd-4e91-b46c-53009c87fbf6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.775995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea0622-1dbd-4e91-b46c-53009c87fbf6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:27.777749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea0622-1dbd-4e91-b46c-53009c87fbf6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:27.788224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 132/274] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:27.794921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8091-cf74-43fe-b158-d4be8113e744 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.805390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8091-cf74-43fe-b158-d4be8113e744 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.810172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72260098-95e5-440e-a783-499732532a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.811126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72260098-95e5-440e-a783-499732532a72 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.811413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72260098-95e5-440e-a783-499732532a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.811743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72260098-95e5-440e-a783-499732532a72 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.813026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72260098-95e5-440e-a783-499732532a72 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:27.815179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72260098-95e5-440e-a783-499732532a72 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:27.822173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 143/275] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:27.824787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea0622-1dbd-4e91-b46c-53009c87fbf6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.836454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea0622-1dbd-4e91-b46c-53009c87fbf6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.841897 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cad51-fdec-4c70-977f-91de40ceb385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.842850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cad51-fdec-4c70-977f-91de40ceb385 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.843133 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cad51-fdec-4c70-977f-91de40ceb385 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.843410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cad51-fdec-4c70-977f-91de40ceb385 admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.845083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cad51-fdec-4c70-977f-91de40ceb385 admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:27.847203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cad51-fdec-4c70-977f-91de40ceb385 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:27.849041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 133/276] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:27.857035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72260098-95e5-440e-a783-499732532a72 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:27.868574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72260098-95e5-440e-a783-499732532a72 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:27.875157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae053f68-35cc-49cc-9a96-38ff9ecff982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:27.875812 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053f68-35cc-49cc-9a96-38ff9ecff982 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:27.876094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053f68-35cc-49cc-9a96-38ff9ecff982 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:27.876369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053f68-35cc-49cc-9a96-38ff9ecff982 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:27.877203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae053f68-35cc-49cc-9a96-38ff9ecff982 admin admin] RBAC: Adding query filter params (group.id=e538691385fd4b95a990ca4bbe39151c, role.id=b3e69d8143774de5aa40d1fd070a8c03, scope.project.id=73f23529c97d4072a14818ca767c4258) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:27.877513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae053f68-35cc-49cc-9a96-38ff9ecff982 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:27.879385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae053f68-35cc-49cc-9a96-38ff9ecff982 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:27.886008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 144/277] 10.222.0.23 () {56 vars in 1398 bytes} [Wed Aug 25 01:15:27 2021] GET /identity/v3/role_assignments?group.id=e538691385fd4b95a990ca4bbe39151c&scope.project.id=73f23529c97d4072a14818ca767c4258&role.id=b3e69d8143774de5aa40d1fd070a8c03 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:28.108331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5548-34a6-4a7b-a9b1-8f38ddcaf37e None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:28.108676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5548-34a6-4a7b-a9b1-8f38ddcaf37e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:28.108856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5548-34a6-4a7b-a9b1-8f38ddcaf37e None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:28.110904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 134/278] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:28.117589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aeecb-9bdb-4bba-9bb2-26f6f98f0db5 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:28.117882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aeecb-9bdb-4bba-9bb2-26f6f98f0db5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:28.118146 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aeecb-9bdb-4bba-9bb2-26f6f98f0db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:28.140915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-281aeecb-9bdb-4bba-9bb2-26f6f98f0db5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:28.142149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-281aeecb-9bdb-4bba-9bb2-26f6f98f0db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:28.152963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 145/279] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:28.182053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee5548-34a6-4a7b-a9b1-8f38ddcaf37e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:28.196528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee5548-34a6-4a7b-a9b1-8f38ddcaf37e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:28.202341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719da7-4f9f-43f5-a33b-711d3c6edefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:28.203158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719da7-4f9f-43f5-a33b-711d3c6edefb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:28.203492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719da7-4f9f-43f5-a33b-711d3c6edefb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:28.203772 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719da7-4f9f-43f5-a33b-711d3c6edefb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:28.218636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f719da7-4f9f-43f5-a33b-711d3c6edefb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:28.225748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-1f719da7-4f9f-43f5-a33b-711d3c6edefb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:28.227013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 135/280] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:28.233664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aeecb-9bdb-4bba-9bb2-26f6f98f0db5 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:28.244717 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aeecb-9bdb-4bba-9bb2-26f6f98f0db5 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:28.256042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd7cb2-91ee-4617-866d-a747c6df759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:28.256719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd7cb2-91ee-4617-866d-a747c6df759f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:28.257006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd7cb2-91ee-4617-866d-a747c6df759f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:28.257336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd7cb2-91ee-4617-866d-a747c6df759f admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:28.258098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd7cb2-91ee-4617-866d-a747c6df759f admin admin] RBAC: Adding query filter params (name=member) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:28.258406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd7cb2-91ee-4617-866d-a747c6df759f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:28.260119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd7cb2-91ee-4617-866d-a747c6df759f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:28.273789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 146/281] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:28.280150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719da7-4f9f-43f5-a33b-711d3c6edefb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:28.292594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719da7-4f9f-43f5-a33b-711d3c6edefb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:28.299687 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb28444-156e-4518-a047-b59bfe4ea1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:28.300595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb28444-156e-4518-a047-b59bfe4ea1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:28.300877 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb28444-156e-4518-a047-b59bfe4ea1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:28.301156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb28444-156e-4518-a047-b59bfe4ea1e8 admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:28.303396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb28444-156e-4518-a047-b59bfe4ea1e8 admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:28.305405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb28444-156e-4518-a047-b59bfe4ea1e8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:28.307398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 136/282] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:28 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:28.313369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd7cb2-91ee-4617-866d-a747c6df759f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:28.328003 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd7cb2-91ee-4617-866d-a747c6df759f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:28.334934 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1d665-de36-445d-8c70-1937624db73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:28.335803 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1d665-de36-445d-8c70-1937624db73e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:28.336089 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1d665-de36-445d-8c70-1937624db73e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:28.336363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1d665-de36-445d-8c70-1937624db73e admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:28.337548 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1d665-de36-445d-8c70-1937624db73e admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:28.340002 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1d665-de36-445d-8c70-1937624db73e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:28.347267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 147/283] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:28 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:28.348677 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb28444-156e-4518-a047-b59bfe4ea1e8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:28.361394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb28444-156e-4518-a047-b59bfe4ea1e8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:28.366331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea7339-58e4-4432-984c-542e7bf41c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:28.367304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea7339-58e4-4432-984c-542e7bf41c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:28.367489 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea7339-58e4-4432-984c-542e7bf41c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:28.367768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea7339-58e4-4432-984c-542e7bf41c29 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b/groups/e538691385fd4b95a990ca4bbe39151c/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:28.376056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea7339-58e4-4432-984c-542e7bf41c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749968f930fa45ba9591e86301e37c6b, group_id=e538691385fd4b95a990ca4bbe39151c, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:28.378723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea7339-58e4-4432-984c-542e7bf41c29 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:28.406836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 137/284] 10.222.0.23 () {58 vars in 1464 bytes} [Wed Aug 25 01:15:28 2021] PUT /identity/v3/projects/749968f930fa45ba9591e86301e37c6b/groups/e538691385fd4b95a990ca4bbe39151c/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:28.831584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe57b8-55f0-4cb6-a3ad-ecd46b41b9fa None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:28.832285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe57b8-55f0-4cb6-a3ad-ecd46b41b9fa None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:28.832285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe57b8-55f0-4cb6-a3ad-ecd46b41b9fa None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:28.834184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 148/285] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:28.850200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10f63f-4355-4200-9172-aeebe3d13041 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:28.850789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10f63f-4355-4200-9172-aeebe3d13041 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:28.850976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10f63f-4355-4200-9172-aeebe3d13041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:28.871038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-7b10f63f-4355-4200-9172-aeebe3d13041 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:28.872217 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7b10f63f-4355-4200-9172-aeebe3d13041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:28.944982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 138/286] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:28.980921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe57b8-55f0-4cb6-a3ad-ecd46b41b9fa None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:28.999388 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe57b8-55f0-4cb6-a3ad-ecd46b41b9fa None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:29.004011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10879ea9-04ee-4a37-af36-fe2bb7b3d3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:29.004856 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10879ea9-04ee-4a37-af36-fe2bb7b3d3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.005137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10879ea9-04ee-4a37-af36-fe2bb7b3d3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.005411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10879ea9-04ee-4a37-af36-fe2bb7b3d3c0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.021667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10879ea9-04ee-4a37-af36-fe2bb7b3d3c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:29.029019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-10879ea9-04ee-4a37-af36-fe2bb7b3d3c0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:29.030410 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 149/287] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:29.037205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10f63f-4355-4200-9172-aeebe3d13041 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:29.046473 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10f63f-4355-4200-9172-aeebe3d13041 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:29.053814 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9ed4b-4d64-4994-ae22-453fcdb52651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:29.054480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ed4b-4d64-4994-ae22-453fcdb52651 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.054784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ed4b-4d64-4994-ae22-453fcdb52651 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.055059 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9ed4b-4d64-4994-ae22-453fcdb52651 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.055819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9ed4b-4d64-4994-ae22-453fcdb52651 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:29.056125 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9ed4b-4d64-4994-ae22-453fcdb52651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:29.057711 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9ed4b-4d64-4994-ae22-453fcdb52651 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:29.066909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 139/288] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:29.073143 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10879ea9-04ee-4a37-af36-fe2bb7b3d3c0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:29.084124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10879ea9-04ee-4a37-af36-fe2bb7b3d3c0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:29.094719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca687-033a-4081-b27e-0ba6006bce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:29.095577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca687-033a-4081-b27e-0ba6006bce31 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.095855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca687-033a-4081-b27e-0ba6006bce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.096124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca687-033a-4081-b27e-0ba6006bce31 admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.097303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eca687-033a-4081-b27e-0ba6006bce31 admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:29.099802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eca687-033a-4081-b27e-0ba6006bce31 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:29.101383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 150/289] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:29 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:29.107436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9ed4b-4d64-4994-ae22-453fcdb52651 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:29.117237 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9ed4b-4d64-4994-ae22-453fcdb52651 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:29.123076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162ade2-5306-4882-ad8f-ad58f54378d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:29.123930 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ade2-5306-4882-ad8f-ad58f54378d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.124203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ade2-5306-4882-ad8f-ad58f54378d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.124471 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ade2-5306-4882-ad8f-ad58f54378d4 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.131436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162ade2-5306-4882-ad8f-ad58f54378d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:29.133495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162ade2-5306-4882-ad8f-ad58f54378d4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:29.135220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 140/290] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:29 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:29.141642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca687-033a-4081-b27e-0ba6006bce31 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:29.152148 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca687-033a-4081-b27e-0ba6006bce31 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:29.163569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32fa2a-ac28-49f3-bcbc-969d08beea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:29.164461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32fa2a-ac28-49f3-bcbc-969d08beea41 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.164801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32fa2a-ac28-49f3-bcbc-969d08beea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.165076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32fa2a-ac28-49f3-bcbc-969d08beea41 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b/groups/e538691385fd4b95a990ca4bbe39151c/roles/b3e69d8143774de5aa40d1fd070a8c03` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.171582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32fa2a-ac28-49f3-bcbc-969d08beea41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749968f930fa45ba9591e86301e37c6b, group_id=e538691385fd4b95a990ca4bbe39151c, role_id=b3e69d8143774de5aa40d1fd070a8c03)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:29.174326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32fa2a-ac28-49f3-bcbc-969d08beea41 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:29.200469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 151/291] 10.222.0.23 () {58 vars in 1464 bytes} [Wed Aug 25 01:15:29 2021] PUT /identity/v3/projects/749968f930fa45ba9591e86301e37c6b/groups/e538691385fd4b95a990ca4bbe39151c/roles/b3e69d8143774de5aa40d1fd070a8c03 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:29.551326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb318c31-514a-4bed-96db-95008a378f79 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.551687 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb318c31-514a-4bed-96db-95008a378f79 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.551904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb318c31-514a-4bed-96db-95008a378f79 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.553974 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 141/292] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:29.560397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0dd16-8269-4637-9220-a458e7885c8f None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.560690 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0dd16-8269-4637-9220-a458e7885c8f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.560968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0dd16-8269-4637-9220-a458e7885c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.580855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-93a0dd16-8269-4637-9220-a458e7885c8f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:29.582042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-93a0dd16-8269-4637-9220-a458e7885c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:29.642622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 152/293] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:29.669891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb318c31-514a-4bed-96db-95008a378f79 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:29.682208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb318c31-514a-4bed-96db-95008a378f79 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:29.686530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3db0c-fb79-4b20-98a2-7b906bf327a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:29.687341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3db0c-fb79-4b20-98a2-7b906bf327a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.687619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3db0c-fb79-4b20-98a2-7b906bf327a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.687894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3db0c-fb79-4b20-98a2-7b906bf327a4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.699405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3db0c-fb79-4b20-98a2-7b906bf327a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:29.706176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-2ba3db0c-fb79-4b20-98a2-7b906bf327a4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:29.707394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 142/294] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:29.714328 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0dd16-8269-4637-9220-a458e7885c8f None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:29.723604 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0dd16-8269-4637-9220-a458e7885c8f None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:29.731420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d88af-d2ea-4ea4-b857-65f6ca17aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:29.732088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d88af-d2ea-4ea4-b857-65f6ca17aebb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.732369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d88af-d2ea-4ea4-b857-65f6ca17aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.732644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d88af-d2ea-4ea4-b857-65f6ca17aebb admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.733388 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d88af-d2ea-4ea4-b857-65f6ca17aebb admin admin] RBAC: Adding query filter params (name=member) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:29.733692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d88af-d2ea-4ea4-b857-65f6ca17aebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:29.735323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d88af-d2ea-4ea4-b857-65f6ca17aebb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:29.744715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 153/295] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:29.751142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3db0c-fb79-4b20-98a2-7b906bf327a4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:29.762963 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3db0c-fb79-4b20-98a2-7b906bf327a4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:29.768304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09578b9-f237-4cd6-a7a7-99e81806ecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:29.769140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09578b9-f237-4cd6-a7a7-99e81806ecab admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.769419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09578b9-f237-4cd6-a7a7-99e81806ecab admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.769690 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09578b9-f237-4cd6-a7a7-99e81806ecab admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.770892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09578b9-f237-4cd6-a7a7-99e81806ecab admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:29.772887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09578b9-f237-4cd6-a7a7-99e81806ecab admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:29.774443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 143/296] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:29 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:29.780453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d88af-d2ea-4ea4-b857-65f6ca17aebb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:29.790251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d88af-d2ea-4ea4-b857-65f6ca17aebb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:29.794633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa80224-f4d5-46e1-993f-984bf44ea584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:29.795509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa80224-f4d5-46e1-993f-984bf44ea584 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.795787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa80224-f4d5-46e1-993f-984bf44ea584 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.796059 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa80224-f4d5-46e1-993f-984bf44ea584 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.797220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa80224-f4d5-46e1-993f-984bf44ea584 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:29.799291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa80224-f4d5-46e1-993f-984bf44ea584 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:29.801083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 154/297] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:29 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:29.807757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09578b9-f237-4cd6-a7a7-99e81806ecab admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:29.818138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09578b9-f237-4cd6-a7a7-99e81806ecab admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:29.822548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a3d6-cd62-4c45-b7f6-a373a57488e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:29.823449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a3d6-cd62-4c45-b7f6-a373a57488e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:29.823727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a3d6-cd62-4c45-b7f6-a373a57488e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:29.824000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a3d6-cd62-4c45-b7f6-a373a57488e7 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258/groups/e538691385fd4b95a990ca4bbe39151c/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:29.825916 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a3d6-cd62-4c45-b7f6-a373a57488e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f23529c97d4072a14818ca767c4258, group_id=e538691385fd4b95a990ca4bbe39151c, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:29.828552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a3d6-cd62-4c45-b7f6-a373a57488e7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:29.841457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 144/298] 10.222.0.23 () {58 vars in 1464 bytes} [Wed Aug 25 01:15:29 2021] PUT /identity/v3/projects/73f23529c97d4072a14818ca767c4258/groups/e538691385fd4b95a990ca4bbe39151c/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:30.680016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2173bd1-692a-428f-a8f4-3cb1f69eb668 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:30.680693 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2173bd1-692a-428f-a8f4-3cb1f69eb668 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:30.680693 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2173bd1-692a-428f-a8f4-3cb1f69eb668 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:30.682721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 155/299] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:30.697414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e54ff-2490-4bf5-969b-3b1831fcd623 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:30.698064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e54ff-2490-4bf5-969b-3b1831fcd623 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:30.698064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e54ff-2490-4bf5-969b-3b1831fcd623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:30.720463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-2c0e54ff-2490-4bf5-969b-3b1831fcd623 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:30.721651 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2c0e54ff-2490-4bf5-969b-3b1831fcd623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:30.749503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a2ccd-6cff-42db-82f6-f9d2227c8876 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:30.749814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a2ccd-6cff-42db-82f6-f9d2227c8876 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:30.750094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a2ccd-6cff-42db-82f6-f9d2227c8876 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:30.752158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 156/300] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:30.759411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486dd85-2d7b-47dd-a431-26c6e9c9b1f7 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:30.760013 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486dd85-2d7b-47dd-a431-26c6e9c9b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:30.760515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486dd85-2d7b-47dd-a431-26c6e9c9b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:30.780454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7486dd85-2d7b-47dd-a431-26c6e9c9b1f7 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:30.782065 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7486dd85-2d7b-47dd-a431-26c6e9c9b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:30.808537 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 145/301] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:30.845721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 157/302] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:30.854214 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e54ff-2490-4bf5-969b-3b1831fcd623 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:30.873247 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e54ff-2490-4bf5-969b-3b1831fcd623 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:30.878701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486dd85-2d7b-47dd-a431-26c6e9c9b1f7 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:30.884227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486dd85-2d7b-47dd-a431-26c6e9c9b1f7 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:30.886380 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2005f64-24cb-467b-8d2f-bfd1e1c4c339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:30.887315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2005f64-24cb-467b-8d2f-bfd1e1c4c339 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:30.887815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2005f64-24cb-467b-8d2f-bfd1e1c4c339 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:30.888438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2005f64-24cb-467b-8d2f-bfd1e1c4c339 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:30.889815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147e44c-d009-4663-bcf2-4d9c05ef1bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:30.890814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147e44c-d009-4663-bcf2-4d9c05ef1bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:30.891296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147e44c-d009-4663-bcf2-4d9c05ef1bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:30.891914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147e44c-d009-4663-bcf2-4d9c05ef1bd0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:30.903609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147e44c-d009-4663-bcf2-4d9c05ef1bd0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:30.912094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2005f64-24cb-467b-8d2f-bfd1e1c4c339 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:30.912462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-d147e44c-d009-4663-bcf2-4d9c05ef1bd0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:30.918806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 158/303] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:30.919246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-f2005f64-24cb-467b-8d2f-bfd1e1c4c339 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:30.920899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147e44c-d009-4663-bcf2-4d9c05ef1bd0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:30.921101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 146/304] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:30.927960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2005f64-24cb-467b-8d2f-bfd1e1c4c339 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:30.932346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147e44c-d009-4663-bcf2-4d9c05ef1bd0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:30.937418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8126c-e8b6-453a-a512-4ee8facb3912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:30.938378 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8126c-e8b6-453a-a512-4ee8facb3912 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:30.939476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8126c-e8b6-453a-a512-4ee8facb3912 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:30.939938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8126c-e8b6-453a-a512-4ee8facb3912 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:30.941065 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8126c-e8b6-453a-a512-4ee8facb3912 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:30.941692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8126c-e8b6-453a-a512-4ee8facb3912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:30.943618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8126c-e8b6-453a-a512-4ee8facb3912 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:30.943858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2005f64-24cb-467b-8d2f-bfd1e1c4c339 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:30.958816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 159/305] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:30.959837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a6cb-1160-4070-950b-077aa518679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:30.960692 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a6cb-1160-4070-950b-077aa518679a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:30.961038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a6cb-1160-4070-950b-077aa518679a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:30.961358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8126c-e8b6-453a-a512-4ee8facb3912 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:30.961463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a6cb-1160-4070-950b-077aa518679a admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:30.962210 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3a6cb-1160-4070-950b-077aa518679a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:30.962609 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3a6cb-1160-4070-950b-077aa518679a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:30.964428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3a6cb-1160-4070-950b-077aa518679a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:30.974167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8126c-e8b6-453a-a512-4ee8facb3912 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:30.980336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cc9bb-bac5-4bb0-8e83-6df1170a286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:30.981848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cc9bb-bac5-4bb0-8e83-6df1170a286e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:30.982340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cc9bb-bac5-4bb0-8e83-6df1170a286e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:30.982852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cc9bb-bac5-4bb0-8e83-6df1170a286e admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:30.983162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 147/306] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:30.984882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cc9bb-bac5-4bb0-8e83-6df1170a286e admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:30.987145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cc9bb-bac5-4bb0-8e83-6df1170a286e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:30.990035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 160/307] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:30 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:30.994805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a6cb-1160-4070-950b-077aa518679a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:30.996603 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cc9bb-bac5-4bb0-8e83-6df1170a286e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:31.007259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cc9bb-bac5-4bb0-8e83-6df1170a286e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:31.012348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a6cb-1160-4070-950b-077aa518679a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:31.014817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f63040-a589-4125-b12c-a9cd2d474efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:31.016010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f63040-a589-4125-b12c-a9cd2d474efe admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:31.016527 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f63040-a589-4125-b12c-a9cd2d474efe admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:31.016977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f63040-a589-4125-b12c-a9cd2d474efe admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:31.018524 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f63040-a589-4125-b12c-a9cd2d474efe admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:31.021014 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f63040-a589-4125-b12c-a9cd2d474efe admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:31.026702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28182d34-98df-42a2-a165-1e21d19ec1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:31.026702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28182d34-98df-42a2-a165-1e21d19ec1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:31.026702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28182d34-98df-42a2-a165-1e21d19ec1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:31.026702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28182d34-98df-42a2-a165-1e21d19ec1e6 admin admin] PATH_INFO: `/v3/groups/c2ea8813233748a7a4c6b8cd8707caee` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:31.027036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28182d34-98df-42a2-a165-1e21d19ec1e6 admin admin] RBAC: Authorizing `identity:get_group(group_id=c2ea8813233748a7a4c6b8cd8707caee)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:31.027266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 161/308] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:30 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:31.028894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28182d34-98df-42a2-a165-1e21d19ec1e6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:31.030714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 148/309] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:30 2021] GET /identity/v3/groups/c2ea8813233748a7a4c6b8cd8707caee => generated 229 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:31.031029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f63040-a589-4125-b12c-a9cd2d474efe admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:31.039610 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28182d34-98df-42a2-a165-1e21d19ec1e6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:31.046151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f63040-a589-4125-b12c-a9cd2d474efe admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:31.052765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335890f-a66f-4e51-836e-d8285ae84e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:31.053717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28182d34-98df-42a2-a165-1e21d19ec1e6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:31.054124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335890f-a66f-4e51-836e-d8285ae84e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:31.054748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335890f-a66f-4e51-836e-d8285ae84e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:31.055227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335890f-a66f-4e51-836e-d8285ae84e9e admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258/groups/e538691385fd4b95a990ca4bbe39151c/roles/b3e69d8143774de5aa40d1fd070a8c03` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:31.057620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335890f-a66f-4e51-836e-d8285ae84e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f23529c97d4072a14818ca767c4258, group_id=e538691385fd4b95a990ca4bbe39151c, role_id=b3e69d8143774de5aa40d1fd070a8c03)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:31.061734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335890f-a66f-4e51-836e-d8285ae84e9e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:31.068715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83c45c-d5a7-4d89-a064-ef29d44171a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:31.069746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83c45c-d5a7-4d89-a064-ef29d44171a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:31.070076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83c45c-d5a7-4d89-a064-ef29d44171a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:31.070339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83c45c-d5a7-4d89-a064-ef29d44171a3 admin admin] PATH_INFO: `/v3/projects/220c843aa1514b7390df45e1ecd50d12` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:31.071734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83c45c-d5a7-4d89-a064-ef29d44171a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=220c843aa1514b7390df45e1ecd50d12)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:31.073514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83c45c-d5a7-4d89-a064-ef29d44171a3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:31.075529 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 149/310] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:31 2021] GET /identity/v3/projects/220c843aa1514b7390df45e1ecd50d12 => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:31.080579 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 162/311] 10.222.0.23 () {58 vars in 1464 bytes} [Wed Aug 25 01:15:31 2021] PUT /identity/v3/projects/73f23529c97d4072a14818ca767c4258/groups/e538691385fd4b95a990ca4bbe39151c/roles/b3e69d8143774de5aa40d1fd070a8c03 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:31.083989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83c45c-d5a7-4d89-a064-ef29d44171a3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:31.096676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83c45c-d5a7-4d89-a064-ef29d44171a3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:31.178591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf5203-32b8-4a11-96f2-37320e712948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:31.179522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf5203-32b8-4a11-96f2-37320e712948 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:31.179810 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf5203-32b8-4a11-96f2-37320e712948 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:31.180090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf5203-32b8-4a11-96f2-37320e712948 admin admin] PATH_INFO: `/v3/projects/220c843aa1514b7390df45e1ecd50d12/groups/c2ea8813233748a7a4c6b8cd8707caee/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:31.181834 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf5203-32b8-4a11-96f2-37320e712948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220c843aa1514b7390df45e1ecd50d12, group_id=c2ea8813233748a7a4c6b8cd8707caee, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:31.184568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf5203-32b8-4a11-96f2-37320e712948 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:31.210611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 150/312] 10.222.0.23 () {58 vars in 1464 bytes} [Wed Aug 25 01:15:31 2021] PUT /identity/v3/projects/220c843aa1514b7390df45e1ecd50d12/groups/c2ea8813233748a7a4c6b8cd8707caee/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:31.878079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8cf3b-eae6-4d81-b674-94cf3de92889 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:31.878079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8cf3b-eae6-4d81-b674-94cf3de92889 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:31.878079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8cf3b-eae6-4d81-b674-94cf3de92889 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:31.879350 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 163/313] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:31.883806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30abf94-080b-4b4f-8822-0125932a4041 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:31.884208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30abf94-080b-4b4f-8822-0125932a4041 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:31.884395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30abf94-080b-4b4f-8822-0125932a4041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:31.907310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c30abf94-080b-4b4f-8822-0125932a4041 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:31.908501 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c30abf94-080b-4b4f-8822-0125932a4041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:31.987086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 151/314] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:32.023372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8cf3b-eae6-4d81-b674-94cf3de92889 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.044305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8cf3b-eae6-4d81-b674-94cf3de92889 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.048421 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1f75-cfc2-45d6-a2d7-e905fa768954 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.048717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1f75-cfc2-45d6-a2d7-e905fa768954 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.049000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1f75-cfc2-45d6-a2d7-e905fa768954 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.050604 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc80001-fcbe-4016-9d29-fe3ba5ea9108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.050841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 152/315] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:32.052024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80001-fcbe-4016-9d29-fe3ba5ea9108 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.052307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80001-fcbe-4016-9d29-fe3ba5ea9108 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.052580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80001-fcbe-4016-9d29-fe3ba5ea9108 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.058132 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f32a0-db46-4f1a-8049-5c3c0c4242f1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.058725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f32a0-db46-4f1a-8049-5c3c0c4242f1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.059223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f32a0-db46-4f1a-8049-5c3c0c4242f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.071612 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc80001-fcbe-4016-9d29-fe3ba5ea9108 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:32.078074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-3e2f32a0-db46-4f1a-8049-5c3c0c4242f1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:32.078809 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-0bc80001-fcbe-4016-9d29-fe3ba5ea9108 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:32.079786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3e2f32a0-db46-4f1a-8049-5c3c0c4242f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:32.080276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 164/316] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:32.086272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc80001-fcbe-4016-9d29-fe3ba5ea9108 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.088695 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 153/317] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:32.105000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc80001-fcbe-4016-9d29-fe3ba5ea9108 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.115448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f32a0-db46-4f1a-8049-5c3c0c4242f1 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.119714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75aae0-9a6a-4755-9642-30f33e50e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.120382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75aae0-9a6a-4755-9642-30f33e50e9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.120661 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75aae0-9a6a-4755-9642-30f33e50e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.120930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75aae0-9a6a-4755-9642-30f33e50e9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.121666 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75aae0-9a6a-4755-9642-30f33e50e9e2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:32.121964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75aae0-9a6a-4755-9642-30f33e50e9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.123583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75aae0-9a6a-4755-9642-30f33e50e9e2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.133564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f32a0-db46-4f1a-8049-5c3c0c4242f1 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.139371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 165/318] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:32.145158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909732c-df2a-4731-8146-d5bb8d8ca493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.145870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75aae0-9a6a-4755-9642-30f33e50e9e2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.145981 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909732c-df2a-4731-8146-d5bb8d8ca493 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.146275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909732c-df2a-4731-8146-d5bb8d8ca493 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.146534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909732c-df2a-4731-8146-d5bb8d8ca493 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.161223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75aae0-9a6a-4755-9642-30f33e50e9e2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.167415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909732c-df2a-4731-8146-d5bb8d8ca493 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:32.177024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7a255-d60a-4db3-97e3-472c501c0c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.177663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7a255-d60a-4db3-97e3-472c501c0c84 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.177941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7a255-d60a-4db3-97e3-472c501c0c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.178214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7a255-d60a-4db3-97e3-472c501c0c84 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.179049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-4909732c-df2a-4731-8146-d5bb8d8ca493 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:32.184828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 154/319] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:32.187223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909732c-df2a-4731-8146-d5bb8d8ca493 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.193964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7a255-d60a-4db3-97e3-472c501c0c84 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.195765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7a255-d60a-4db3-97e3-472c501c0c84 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.199987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909732c-df2a-4731-8146-d5bb8d8ca493 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.208656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 166/320] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:32.213958 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4bab2-9810-47af-b91b-d25db16fc0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.214600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7a255-d60a-4db3-97e3-472c501c0c84 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.214728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4bab2-9810-47af-b91b-d25db16fc0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.214951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4bab2-9810-47af-b91b-d25db16fc0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.215233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4bab2-9810-47af-b91b-d25db16fc0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.215990 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4bab2-9810-47af-b91b-d25db16fc0f2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:32.216300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4bab2-9810-47af-b91b-d25db16fc0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.217899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4bab2-9810-47af-b91b-d25db16fc0f2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.230174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7a255-d60a-4db3-97e3-472c501c0c84 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.236680 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 155/321] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:32.237728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471285c9-be5b-46a8-9d6d-42296d8a942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.238654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471285c9-be5b-46a8-9d6d-42296d8a942b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.239498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471285c9-be5b-46a8-9d6d-42296d8a942b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.239776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471285c9-be5b-46a8-9d6d-42296d8a942b admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.240953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471285c9-be5b-46a8-9d6d-42296d8a942b admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.242499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4bab2-9810-47af-b91b-d25db16fc0f2 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.248644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471285c9-be5b-46a8-9d6d-42296d8a942b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.251420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 167/322] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:32.258440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471285c9-be5b-46a8-9d6d-42296d8a942b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.260811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4bab2-9810-47af-b91b-d25db16fc0f2 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.269188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471285c9-be5b-46a8-9d6d-42296d8a942b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.272017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23337e1f-ef05-4002-9170-07cee87b6584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.272930 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23337e1f-ef05-4002-9170-07cee87b6584 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.273390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23337e1f-ef05-4002-9170-07cee87b6584 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.273914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23337e1f-ef05-4002-9170-07cee87b6584 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.274240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91162a36-6afe-4d27-a5b6-95ea5799e9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.275195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162a36-6afe-4d27-a5b6-95ea5799e9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.275581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162a36-6afe-4d27-a5b6-95ea5799e9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.275917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162a36-6afe-4d27-a5b6-95ea5799e9d3 admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.277186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91162a36-6afe-4d27-a5b6-95ea5799e9d3 admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.282701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91162a36-6afe-4d27-a5b6-95ea5799e9d3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.282701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 168/323] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:32.291560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91162a36-6afe-4d27-a5b6-95ea5799e9d3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.298586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23337e1f-ef05-4002-9170-07cee87b6584 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.300450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23337e1f-ef05-4002-9170-07cee87b6584 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.309506 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91162a36-6afe-4d27-a5b6-95ea5799e9d3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.316856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 156/324] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:15:32.319431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8a243-8c22-48ae-b484-f05df05b7775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.320179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8a243-8c22-48ae-b484-f05df05b7775 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.320458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8a243-8c22-48ae-b484-f05df05b7775 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.320779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8a243-8c22-48ae-b484-f05df05b7775 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.321649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8a243-8c22-48ae-b484-f05df05b7775 admin admin] RBAC: Adding query filter params (group.id=e538691385fd4b95a990ca4bbe39151c, role.id=426e730bef7e42f4bb8753fa9312a9c2, scope.project.id=749968f930fa45ba9591e86301e37c6b) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:32.321956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8a243-8c22-48ae-b484-f05df05b7775 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.324369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23337e1f-ef05-4002-9170-07cee87b6584 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.328973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8a243-8c22-48ae-b484-f05df05b7775 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.337281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23337e1f-ef05-4002-9170-07cee87b6584 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.340319 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 169/325] 10.222.0.23 () {56 vars in 1398 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/role_assignments?group.id=e538691385fd4b95a990ca4bbe39151c&scope.project.id=749968f930fa45ba9591e86301e37c6b&role.id=426e730bef7e42f4bb8753fa9312a9c2 => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:32.350803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dd1aa-93a2-43b9-889a-d1e0ac9cd85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.351800 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dd1aa-93a2-43b9-889a-d1e0ac9cd85e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.352082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dd1aa-93a2-43b9-889a-d1e0ac9cd85e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.352354 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dd1aa-93a2-43b9-889a-d1e0ac9cd85e admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.359769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dd1aa-93a2-43b9-889a-d1e0ac9cd85e admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.361892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dd1aa-93a2-43b9-889a-d1e0ac9cd85e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.364798 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 157/326] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:32.371141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8a243-8c22-48ae-b484-f05df05b7775 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.388638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8a243-8c22-48ae-b484-f05df05b7775 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.399244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd324f-e981-44d3-bf4b-a08078374e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.400163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd324f-e981-44d3-bf4b-a08078374e4f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.400443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd324f-e981-44d3-bf4b-a08078374e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.400718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd324f-e981-44d3-bf4b-a08078374e4f admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.402997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd324f-e981-44d3-bf4b-a08078374e4f admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.404992 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd324f-e981-44d3-bf4b-a08078374e4f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.406890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 170/327] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:32.413977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dd1aa-93a2-43b9-889a-d1e0ac9cd85e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.428996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dd1aa-93a2-43b9-889a-d1e0ac9cd85e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.439236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c91f-6c2e-48fc-a879-e9656fc51cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.439912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c91f-6c2e-48fc-a879-e9656fc51cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.440198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c91f-6c2e-48fc-a879-e9656fc51cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.440478 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c91f-6c2e-48fc-a879-e9656fc51cf7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.441339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8c91f-6c2e-48fc-a879-e9656fc51cf7 admin admin] RBAC: Adding query filter params (group.id=e538691385fd4b95a990ca4bbe39151c, role.id=b3e69d8143774de5aa40d1fd070a8c03, scope.project.id=749968f930fa45ba9591e86301e37c6b) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:32.441651 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8c91f-6c2e-48fc-a879-e9656fc51cf7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.443652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8c91f-6c2e-48fc-a879-e9656fc51cf7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.456090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 158/328] 10.222.0.23 () {56 vars in 1398 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/role_assignments?group.id=e538691385fd4b95a990ca4bbe39151c&scope.project.id=749968f930fa45ba9591e86301e37c6b&role.id=b3e69d8143774de5aa40d1fd070a8c03 => generated 611 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:32.733175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcad247-f533-4fd1-b55e-376c998fa45c None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.733570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcad247-f533-4fd1-b55e-376c998fa45c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.733752 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcad247-f533-4fd1-b55e-376c998fa45c None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.735860 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 171/329] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:32.742096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2d547-7ece-4ccb-bc6e-6c70fc689b30 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.742391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2d547-7ece-4ccb-bc6e-6c70fc689b30 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.742701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2d547-7ece-4ccb-bc6e-6c70fc689b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.767214 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-5cd2d547-7ece-4ccb-bc6e-6c70fc689b30 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:32.768408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5cd2d547-7ece-4ccb-bc6e-6c70fc689b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:32.778090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 159/330] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:32.803662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcad247-f533-4fd1-b55e-376c998fa45c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.819529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcad247-f533-4fd1-b55e-376c998fa45c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.824199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84e9a-44d2-4632-899b-fc4c513302aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.825228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84e9a-44d2-4632-899b-fc4c513302aa admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.825710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84e9a-44d2-4632-899b-fc4c513302aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.826202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84e9a-44d2-4632-899b-fc4c513302aa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.837972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84e9a-44d2-4632-899b-fc4c513302aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:32.845278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-43e84e9a-44d2-4632-899b-fc4c513302aa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 01:15:32.851125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 172/331] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:32.854456 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2d547-7ece-4ccb-bc6e-6c70fc689b30 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.863770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2d547-7ece-4ccb-bc6e-6c70fc689b30 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.870129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417c59-09db-4b3b-aca6-9b0abf1f709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.871008 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417c59-09db-4b3b-aca6-9b0abf1f709c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.871438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417c59-09db-4b3b-aca6-9b0abf1f709c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.871858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417c59-09db-4b3b-aca6-9b0abf1f709c admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.872766 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417c59-09db-4b3b-aca6-9b0abf1f709c admin admin] RBAC: Adding query filter params (name=member) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:32.873235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417c59-09db-4b3b-aca6-9b0abf1f709c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.875074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417c59-09db-4b3b-aca6-9b0abf1f709c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.885655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 160/332] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:32.892100 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84e9a-44d2-4632-899b-fc4c513302aa admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.903490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84e9a-44d2-4632-899b-fc4c513302aa admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.908170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f0e62-aa92-4bb7-a948-6eae4f503579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.908947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0e62-aa92-4bb7-a948-6eae4f503579 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.909328 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0e62-aa92-4bb7-a948-6eae4f503579 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.909727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0e62-aa92-4bb7-a948-6eae4f503579 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.918947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f0e62-aa92-4bb7-a948-6eae4f503579 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.920815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f0e62-aa92-4bb7-a948-6eae4f503579 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.933622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 173/333] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:32.939833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417c59-09db-4b3b-aca6-9b0abf1f709c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.952410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417c59-09db-4b3b-aca6-9b0abf1f709c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.957001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b66e-3cd8-4293-8e90-70a9750a1cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.958819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b66e-3cd8-4293-8e90-70a9750a1cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.959280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b66e-3cd8-4293-8e90-70a9750a1cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.959727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b66e-3cd8-4293-8e90-70a9750a1cb8 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.961105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19b66e-3cd8-4293-8e90-70a9750a1cb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.963457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19b66e-3cd8-4293-8e90-70a9750a1cb8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.965318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 161/334] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:32.971608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f0e62-aa92-4bb7-a948-6eae4f503579 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:32.981300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f0e62-aa92-4bb7-a948-6eae4f503579 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:32.985988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47067fb1-cb64-497c-9b00-3532d35fe29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:32.987079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47067fb1-cb64-497c-9b00-3532d35fe29a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:32.987537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47067fb1-cb64-497c-9b00-3532d35fe29a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:32.987980 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47067fb1-cb64-497c-9b00-3532d35fe29a admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:32.989337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47067fb1-cb64-497c-9b00-3532d35fe29a admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:32.991411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47067fb1-cb64-497c-9b00-3532d35fe29a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:32.993174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 174/335] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:32.999964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b66e-3cd8-4293-8e90-70a9750a1cb8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:33.009705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b66e-3cd8-4293-8e90-70a9750a1cb8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:33.016302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda15fff-9f80-4604-8934-bac93855c047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:33.016972 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15fff-9f80-4604-8934-bac93855c047 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.017258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15fff-9f80-4604-8934-bac93855c047 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.017534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda15fff-9f80-4604-8934-bac93855c047 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.018355 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda15fff-9f80-4604-8934-bac93855c047 admin admin] RBAC: Adding query filter params (group.id=e538691385fd4b95a990ca4bbe39151c, role.id=426e730bef7e42f4bb8753fa9312a9c2, scope.project.id=73f23529c97d4072a14818ca767c4258) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:33.018666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda15fff-9f80-4604-8934-bac93855c047 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:33.021077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda15fff-9f80-4604-8934-bac93855c047 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:33.028737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 162/336] 10.222.0.23 () {56 vars in 1398 bytes} [Wed Aug 25 01:15:32 2021] GET /identity/v3/role_assignments?group.id=e538691385fd4b95a990ca4bbe39151c&scope.project.id=73f23529c97d4072a14818ca767c4258&role.id=426e730bef7e42f4bb8753fa9312a9c2 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:33.651257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f40ac-056f-4818-b8b2-39916274a52c None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.651539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f40ac-056f-4818-b8b2-39916274a52c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.651814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f40ac-056f-4818-b8b2-39916274a52c None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.653595 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 175/337] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:33.659433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063fe0c-8404-43a2-9564-81b09789c572 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.659726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063fe0c-8404-43a2-9564-81b09789c572 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.660004 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063fe0c-8404-43a2-9564-81b09789c572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.678167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b063fe0c-8404-43a2-9564-81b09789c572 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:33.679377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b063fe0c-8404-43a2-9564-81b09789c572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:33.686646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 163/338] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:33.710533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f40ac-056f-4818-b8b2-39916274a52c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:33.722369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f40ac-056f-4818-b8b2-39916274a52c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:33.726524 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337cb6-496c-4124-855a-8d03645bf9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:33.727335 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337cb6-496c-4124-855a-8d03645bf9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.727621 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337cb6-496c-4124-855a-8d03645bf9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.727892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337cb6-496c-4124-855a-8d03645bf9f7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.737987 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb337cb6-496c-4124-855a-8d03645bf9f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:33.745713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-bb337cb6-496c-4124-855a-8d03645bf9f7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:33.746892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 176/339] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:33 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:33.753202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063fe0c-8404-43a2-9564-81b09789c572 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:33.762578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063fe0c-8404-43a2-9564-81b09789c572 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:33.767028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f933-a6ca-49d6-8088-7bc68332c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:33.767674 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f933-a6ca-49d6-8088-7bc68332c6ff admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.767955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f933-a6ca-49d6-8088-7bc68332c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.768228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f933-a6ca-49d6-8088-7bc68332c6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.768969 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f933-a6ca-49d6-8088-7bc68332c6ff admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:33.769266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f933-a6ca-49d6-8088-7bc68332c6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:33.770907 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f933-a6ca-49d6-8088-7bc68332c6ff admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:33.779043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 164/340] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:33 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:33.785824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337cb6-496c-4124-855a-8d03645bf9f7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:33.796083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337cb6-496c-4124-855a-8d03645bf9f7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:33.800590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba992b-4f6c-4098-9eae-999fca10343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:33.801256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba992b-4f6c-4098-9eae-999fca10343d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.802025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba992b-4f6c-4098-9eae-999fca10343d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.802301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba992b-4f6c-4098-9eae-999fca10343d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.811681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba992b-4f6c-4098-9eae-999fca10343d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:33.813453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba992b-4f6c-4098-9eae-999fca10343d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:33.823452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 177/341] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:33.830116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f933-a6ca-49d6-8088-7bc68332c6ff admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:33.839521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f933-a6ca-49d6-8088-7bc68332c6ff admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:33.843659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43962315-7f55-4011-ae34-0499632f0126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:33.844491 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43962315-7f55-4011-ae34-0499632f0126 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.844770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43962315-7f55-4011-ae34-0499632f0126 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.845042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43962315-7f55-4011-ae34-0499632f0126 admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.846188 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43962315-7f55-4011-ae34-0499632f0126 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:33.848721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43962315-7f55-4011-ae34-0499632f0126 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:33.850325 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 165/342] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:33 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:33.856428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba992b-4f6c-4098-9eae-999fca10343d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:33.861114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd72aa-a9fd-4838-96c6-ca85011e4a37 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.861408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd72aa-a9fd-4838-96c6-ca85011e4a37 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.861687 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd72aa-a9fd-4838-96c6-ca85011e4a37 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.863410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 166/343] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:33.865919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba992b-4f6c-4098-9eae-999fca10343d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:33.869311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9d6ab-e776-4fc4-a280-569926e3ccf5 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.869601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9d6ab-e776-4fc4-a280-569926e3ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.869886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9d6ab-e776-4fc4-a280-569926e3ccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.870919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370682b9-c07e-495d-92ac-5f46a45a7d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:33.871750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370682b9-c07e-495d-92ac-5f46a45a7d6c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.872028 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370682b9-c07e-495d-92ac-5f46a45a7d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.872300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370682b9-c07e-495d-92ac-5f46a45a7d6c admin admin] PATH_INFO: `/v3/groups/e538691385fd4b95a990ca4bbe39151c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.873435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370682b9-c07e-495d-92ac-5f46a45a7d6c admin admin] RBAC: Authorizing `identity:get_group(group_id=e538691385fd4b95a990ca4bbe39151c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:33.875363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370682b9-c07e-495d-92ac-5f46a45a7d6c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:33.876897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 178/344] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:33 2021] GET /identity/v3/groups/e538691385fd4b95a990ca4bbe39151c => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:33.883187 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370682b9-c07e-495d-92ac-5f46a45a7d6c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:33.887106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-88e9d6ab-e776-4fc4-a280-569926e3ccf5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:33.888535 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-88e9d6ab-e776-4fc4-a280-569926e3ccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:33.892681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370682b9-c07e-495d-92ac-5f46a45a7d6c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:33.896178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 167/345] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:33.898826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8ccca-9a2a-4e59-b8e6-b68a7d36d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:33.898826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8ccca-9a2a-4e59-b8e6-b68a7d36d07f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.898826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8ccca-9a2a-4e59-b8e6-b68a7d36d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.898826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8ccca-9a2a-4e59-b8e6-b68a7d36d07f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.899107 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8ccca-9a2a-4e59-b8e6-b68a7d36d07f admin admin] RBAC: Adding query filter params (group.id=e538691385fd4b95a990ca4bbe39151c, role.id=b3e69d8143774de5aa40d1fd070a8c03, scope.project.id=73f23529c97d4072a14818ca767c4258) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:33.899184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8ccca-9a2a-4e59-b8e6-b68a7d36d07f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:33.901234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8ccca-9a2a-4e59-b8e6-b68a7d36d07f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:33.907090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 179/346] 10.222.0.23 () {56 vars in 1398 bytes} [Wed Aug 25 01:15:33 2021] GET /identity/v3/role_assignments?group.id=e538691385fd4b95a990ca4bbe39151c&scope.project.id=73f23529c97d4072a14818ca767c4258&role.id=b3e69d8143774de5aa40d1fd070a8c03 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:33.921106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9d6ab-e776-4fc4-a280-569926e3ccf5 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:33.931138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9d6ab-e776-4fc4-a280-569926e3ccf5 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:33.935632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e969e-2034-48a5-9776-c6f8facc1de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:33.936451 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e969e-2034-48a5-9776-c6f8facc1de8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.936733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e969e-2034-48a5-9776-c6f8facc1de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.937009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e969e-2034-48a5-9776-c6f8facc1de8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.948567 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e969e-2034-48a5-9776-c6f8facc1de8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:33.955575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-120e969e-2034-48a5-9776-c6f8facc1de8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:33.957075 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 168/347] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:33.963617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8ccca-9a2a-4e59-b8e6-b68a7d36d07f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:33.974099 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8ccca-9a2a-4e59-b8e6-b68a7d36d07f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:33.978589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2a1d6-4bbe-4de5-83f7-a7dc113f52c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:33.979302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2a1d6-4bbe-4de5-83f7-a7dc113f52c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:33.979590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2a1d6-4bbe-4de5-83f7-a7dc113f52c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:33.979872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2a1d6-4bbe-4de5-83f7-a7dc113f52c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:33.980644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2a1d6-4bbe-4de5-83f7-a7dc113f52c8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:33.980954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2a1d6-4bbe-4de5-83f7-a7dc113f52c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:33.982583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2a1d6-4bbe-4de5-83f7-a7dc113f52c8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:33.992433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 180/348] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:33.998463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e969e-2034-48a5-9776-c6f8facc1de8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:34.008400 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e969e-2034-48a5-9776-c6f8facc1de8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:34.012768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4c530-fb4f-4261-97e9-93025a9651fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:34.013617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4c530-fb4f-4261-97e9-93025a9651fc admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:34.013896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4c530-fb4f-4261-97e9-93025a9651fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:34.014169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4c530-fb4f-4261-97e9-93025a9651fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:34.023218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4c530-fb4f-4261-97e9-93025a9651fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:34.024988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4c530-fb4f-4261-97e9-93025a9651fc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:34.034483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 169/349] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:34.041471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2a1d6-4bbe-4de5-83f7-a7dc113f52c8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:34.051426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2a1d6-4bbe-4de5-83f7-a7dc113f52c8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:34.056360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09005c50-aadf-47e9-b608-ef4b9cd7acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:34.057244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09005c50-aadf-47e9-b608-ef4b9cd7acfb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:34.057527 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09005c50-aadf-47e9-b608-ef4b9cd7acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:34.057801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09005c50-aadf-47e9-b608-ef4b9cd7acfb admin admin] PATH_INFO: `/v3/projects/220c843aa1514b7390df45e1ecd50d12` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:34.058977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09005c50-aadf-47e9-b608-ef4b9cd7acfb admin admin] RBAC: Authorizing `identity:get_project(project_id=220c843aa1514b7390df45e1ecd50d12)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:34.060758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09005c50-aadf-47e9-b608-ef4b9cd7acfb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:34.062580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 181/350] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:15:34 2021] GET /identity/v3/projects/220c843aa1514b7390df45e1ecd50d12 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:34.069480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4c530-fb4f-4261-97e9-93025a9651fc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:34.078310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4c530-fb4f-4261-97e9-93025a9651fc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:34.082722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4ccdd-f690-49f8-a16b-28df4b0e9c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:34.083555 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4ccdd-f690-49f8-a16b-28df4b0e9c0b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:34.083835 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4ccdd-f690-49f8-a16b-28df4b0e9c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:34.084106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4ccdd-f690-49f8-a16b-28df4b0e9c0b admin admin] PATH_INFO: `/v3/groups/c2ea8813233748a7a4c6b8cd8707caee` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:34.085253 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4ccdd-f690-49f8-a16b-28df4b0e9c0b admin admin] RBAC: Authorizing `identity:get_group(group_id=c2ea8813233748a7a4c6b8cd8707caee)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:34.087212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4ccdd-f690-49f8-a16b-28df4b0e9c0b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:34.088767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 170/351] 10.222.0.23 () {56 vars in 1202 bytes} [Wed Aug 25 01:15:34 2021] GET /identity/v3/groups/c2ea8813233748a7a4c6b8cd8707caee => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:34.095332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09005c50-aadf-47e9-b608-ef4b9cd7acfb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:34.105814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09005c50-aadf-47e9-b608-ef4b9cd7acfb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:34.110268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904113bf-536b-4111-89e6-772d0b4b3149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:34.110944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904113bf-536b-4111-89e6-772d0b4b3149 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:34.111228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904113bf-536b-4111-89e6-772d0b4b3149 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:34.111502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904113bf-536b-4111-89e6-772d0b4b3149 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:34.112320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904113bf-536b-4111-89e6-772d0b4b3149 admin admin] RBAC: Adding query filter params (group.id=c2ea8813233748a7a4c6b8cd8707caee, role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=220c843aa1514b7390df45e1ecd50d12) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:34.112634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904113bf-536b-4111-89e6-772d0b4b3149 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:34.115084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904113bf-536b-4111-89e6-772d0b4b3149 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:34.120964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 182/352] 10.222.0.23 () {56 vars in 1398 bytes} [Wed Aug 25 01:15:34 2021] GET /identity/v3/role_assignments?group.id=c2ea8813233748a7a4c6b8cd8707caee&scope.project.id=220c843aa1514b7390df45e1ecd50d12&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:36.687299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39f281-5acf-45a1-95e4-c63ddc88979b None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:36.687806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39f281-5acf-45a1-95e4-c63ddc88979b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:36.687909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39f281-5acf-45a1-95e4-c63ddc88979b None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:36.690000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 171/353] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:36.696516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47551d-4db4-4b4c-8fb4-44aba13fdfc6 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:36.696955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47551d-4db4-4b4c-8fb4-44aba13fdfc6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:36.697190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47551d-4db4-4b4c-8fb4-44aba13fdfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:36.716348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7e47551d-4db4-4b4c-8fb4-44aba13fdfc6 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:36.717543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7e47551d-4db4-4b4c-8fb4-44aba13fdfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:36.725975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 183/354] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:36.751955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39f281-5acf-45a1-95e4-c63ddc88979b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:36.765603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39f281-5acf-45a1-95e4-c63ddc88979b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:36.769849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a8166-c047-49cd-a616-f92119a84f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:36.771049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a8166-c047-49cd-a616-f92119a84f76 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:36.771331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a8166-c047-49cd-a616-f92119a84f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:36.771606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a8166-c047-49cd-a616-f92119a84f76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:36.783464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a8166-c047-49cd-a616-f92119a84f76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:36.785282 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a8166-c047-49cd-a616-f92119a84f76 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:36.802542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-3a5a8166-c047-49cd-a616-f92119a84f76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:36.803764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 172/355] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:36.810258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47551d-4db4-4b4c-8fb4-44aba13fdfc6 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:36.820292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47551d-4db4-4b4c-8fb4-44aba13fdfc6 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:36.825032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03e28f-acde-415c-b8b6-e9cdd648d77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:36.825713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03e28f-acde-415c-b8b6-e9cdd648d77f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:36.825995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03e28f-acde-415c-b8b6-e9cdd648d77f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:36.826271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03e28f-acde-415c-b8b6-e9cdd648d77f admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:36.827046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03e28f-acde-415c-b8b6-e9cdd648d77f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:36.827352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03e28f-acde-415c-b8b6-e9cdd648d77f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:36.828385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-da03e28f-acde-415c-b8b6-e9cdd648d77f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:36.828385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:36.828385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:36.829271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03e28f-acde-415c-b8b6-e9cdd648d77f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:36.849270 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 184/356] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:36.855505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a8166-c047-49cd-a616-f92119a84f76 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:36.868007 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a8166-c047-49cd-a616-f92119a84f76 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:36.876948 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52d639-098e-46a1-9d39-fa650f42dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:36.877630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52d639-098e-46a1-9d39-fa650f42dfef admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:36.877914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52d639-098e-46a1-9d39-fa650f42dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:36.878191 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52d639-098e-46a1-9d39-fa650f42dfef admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:36.878936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52d639-098e-46a1-9d39-fa650f42dfef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:36.880891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52d639-098e-46a1-9d39-fa650f42dfef admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:36.915504 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 173/357] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:15:36 2021] POST /identity/v3/users => generated 246 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:36.935495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5bf69-7b62-4289-928d-b21d2c7ab156 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:36.935824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5bf69-7b62-4289-928d-b21d2c7ab156 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:36.936055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5bf69-7b62-4289-928d-b21d2c7ab156 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:36.937882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 185/358] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:36.944538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc778f-38de-4284-af9a-79e99ff4d163 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:36.945143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc778f-38de-4284-af9a-79e99ff4d163 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:36.945644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc778f-38de-4284-af9a-79e99ff4d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:36.983857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-06dc778f-38de-4284-af9a-79e99ff4d163 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:36.985437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-06dc778f-38de-4284-af9a-79e99ff4d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:36.999935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 174/359] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:37.043602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5bf69-7b62-4289-928d-b21d2c7ab156 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:37.061235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5bf69-7b62-4289-928d-b21d2c7ab156 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:37.065692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902c9ac-e244-4939-9630-fbf769907df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:37.066514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902c9ac-e244-4939-9630-fbf769907df2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.066828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902c9ac-e244-4939-9630-fbf769907df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.067154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902c9ac-e244-4939-9630-fbf769907df2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.083670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902c9ac-e244-4939-9630-fbf769907df2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:37.085534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902c9ac-e244-4939-9630-fbf769907df2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:37.214550 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6ec4-f7a8-49f9-bf92-d3e92cb1fd25 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.215237 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6ec4-f7a8-49f9-bf92-d3e92cb1fd25 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.215738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6ec4-f7a8-49f9-bf92-d3e92cb1fd25 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.217982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 175/360] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:37.224947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-e902c9ac-e244-4939-9630-fbf769907df2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:37.226193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 186/361] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:37.226731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a304b-f5d6-4aef-b056-a2f74b68f40b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.227283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a304b-f5d6-4aef-b056-a2f74b68f40b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.227756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a304b-f5d6-4aef-b056-a2f74b68f40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.232924 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902c9ac-e244-4939-9630-fbf769907df2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:37.245385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902c9ac-e244-4939-9630-fbf769907df2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:37.250895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399f1f1-2413-41f2-ae29-86456696b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:37.251675 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399f1f1-2413-41f2-ae29-86456696b055 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.251965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399f1f1-2413-41f2-ae29-86456696b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.252247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399f1f1-2413-41f2-ae29-86456696b055 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.252975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399f1f1-2413-41f2-ae29-86456696b055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:37.253252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-769a304b-f5d6-4aef-b056-a2f74b68f40b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:37.253356 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399f1f1-2413-41f2-ae29-86456696b055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:37.254837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-769a304b-f5d6-4aef-b056-a2f74b68f40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:37.255036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399f1f1-2413-41f2-ae29-86456696b055 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:37.265984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 176/362] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:37.269393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 187/363] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:37.278696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a304b-f5d6-4aef-b056-a2f74b68f40b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:37.286951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a304b-f5d6-4aef-b056-a2f74b68f40b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:37.292363 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa086f0-69bb-4700-b340-31d969187bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:37.293036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa086f0-69bb-4700-b340-31d969187bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.293488 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa086f0-69bb-4700-b340-31d969187bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.294493 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399f1f1-2413-41f2-ae29-86456696b055 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:37.294615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa086f0-69bb-4700-b340-31d969187bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.295319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa086f0-69bb-4700-b340-31d969187bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:37.297244 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa086f0-69bb-4700-b340-31d969187bd4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:37.304688 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399f1f1-2413-41f2-ae29-86456696b055 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:37.311009 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75544da9-b3c7-4f69-b75b-86e47d981e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:37.312074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75544da9-b3c7-4f69-b75b-86e47d981e3a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.312455 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75544da9-b3c7-4f69-b75b-86e47d981e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.312815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75544da9-b3c7-4f69-b75b-86e47d981e3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.326061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 177/364] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:15:37 2021] POST /identity/v3/users => generated 248 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:37.333804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75544da9-b3c7-4f69-b75b-86e47d981e3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:37.336345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75544da9-b3c7-4f69-b75b-86e47d981e3a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:37.356810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-75544da9-b3c7-4f69-b75b-86e47d981e3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:37.358880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 188/365] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:37.365342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa086f0-69bb-4700-b340-31d969187bd4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:37.376070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa086f0-69bb-4700-b340-31d969187bd4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:37.384827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578a343-12f5-4d33-a279-c72364f6bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:37.385513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578a343-12f5-4d33-a279-c72364f6bf21 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.385795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578a343-12f5-4d33-a279-c72364f6bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.386075 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578a343-12f5-4d33-a279-c72364f6bf21 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.386947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578a343-12f5-4d33-a279-c72364f6bf21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:37.387259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578a343-12f5-4d33-a279-c72364f6bf21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:37.389179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578a343-12f5-4d33-a279-c72364f6bf21 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:37.417617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 178/366] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:37.423779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75544da9-b3c7-4f69-b75b-86e47d981e3a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:37.440262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75544da9-b3c7-4f69-b75b-86e47d981e3a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:37.445306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a4462-7341-4076-bbdb-12ae63c90533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:37.446295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a4462-7341-4076-bbdb-12ae63c90533 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.446850 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a4462-7341-4076-bbdb-12ae63c90533 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.447324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a4462-7341-4076-bbdb-12ae63c90533 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.448296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a4462-7341-4076-bbdb-12ae63c90533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:37.450545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a4462-7341-4076-bbdb-12ae63c90533 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:37.472656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 189/367] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:15:37 2021] POST /identity/v3/users => generated 248 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:37.817958 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c251f61-2f87-4afa-a052-46cbfd267d6c None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.818477 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c251f61-2f87-4afa-a052-46cbfd267d6c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.818553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c251f61-2f87-4afa-a052-46cbfd267d6c None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.820523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 179/368] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:37.826605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0807b-1733-4a2d-8eda-9eca3eba6e05 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.827459 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0807b-1733-4a2d-8eda-9eca3eba6e05 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.827939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0807b-1733-4a2d-8eda-9eca3eba6e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.847310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-aaf0807b-1733-4a2d-8eda-9eca3eba6e05 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:37.849398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-aaf0807b-1733-4a2d-8eda-9eca3eba6e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:37.857422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 190/369] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:37.883081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c251f61-2f87-4afa-a052-46cbfd267d6c None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:37.896302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c251f61-2f87-4afa-a052-46cbfd267d6c None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:37.905093 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e134c-b094-400a-81de-5c4cbf6de004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:37.906172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e134c-b094-400a-81de-5c4cbf6de004 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.906657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e134c-b094-400a-81de-5c4cbf6de004 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.907168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e134c-b094-400a-81de-5c4cbf6de004 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.921809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e134c-b094-400a-81de-5c4cbf6de004 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:37.923954 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e134c-b094-400a-81de-5c4cbf6de004 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:37.942077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-541e134c-b094-400a-81de-5c4cbf6de004 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:37.943605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 180/370] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:37.950120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0807b-1733-4a2d-8eda-9eca3eba6e05 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:37.960063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0807b-1733-4a2d-8eda-9eca3eba6e05 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:37.964840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41c3c5-8045-4aa4-8c14-9d3fc34129e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:37.965755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c3c5-8045-4aa4-8c14-9d3fc34129e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:37.966238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c3c5-8045-4aa4-8c14-9d3fc34129e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:37.966799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c3c5-8045-4aa4-8c14-9d3fc34129e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:37.967903 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41c3c5-8045-4aa4-8c14-9d3fc34129e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:37.968411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41c3c5-8045-4aa4-8c14-9d3fc34129e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:37.970228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41c3c5-8045-4aa4-8c14-9d3fc34129e0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:37.983012 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 191/371] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:37.989421 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e134c-b094-400a-81de-5c4cbf6de004 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:37.999724 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e134c-b094-400a-81de-5c4cbf6de004 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:38.004546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e1cfc-003e-427d-9a54-1f8886b72ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:38.005564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e1cfc-003e-427d-9a54-1f8886b72ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:38.006089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e1cfc-003e-427d-9a54-1f8886b72ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:38.006564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e1cfc-003e-427d-9a54-1f8886b72ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:38.007527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e1cfc-003e-427d-9a54-1f8886b72ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:38.009675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e1cfc-003e-427d-9a54-1f8886b72ea2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:38.034695 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 181/372] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:15:37 2021] POST /identity/v3/users => generated 249 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:38.522996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752afb95-13ec-4bad-8d1a-ccf2121f8054 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:38.523522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752afb95-13ec-4bad-8d1a-ccf2121f8054 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:38.523805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752afb95-13ec-4bad-8d1a-ccf2121f8054 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:38.525828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 192/373] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:38.534590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3fba3-a12c-48c4-9bb8-0eec7aca1613 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:38.535195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3fba3-a12c-48c4-9bb8-0eec7aca1613 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:38.535737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3fba3-a12c-48c4-9bb8-0eec7aca1613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:38.553865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-67b3fba3-a12c-48c4-9bb8-0eec7aca1613 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:38.555517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-67b3fba3-a12c-48c4-9bb8-0eec7aca1613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:38.563736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 182/374] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:38.588765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752afb95-13ec-4bad-8d1a-ccf2121f8054 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:38.602396 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752afb95-13ec-4bad-8d1a-ccf2121f8054 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:38.607119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902311-744e-4f25-8ae3-d50fd9260994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:38.608031 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902311-744e-4f25-8ae3-d50fd9260994 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:38.608521 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902311-744e-4f25-8ae3-d50fd9260994 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:38.609085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902311-744e-4f25-8ae3-d50fd9260994 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:38.610056 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e902311-744e-4f25-8ae3-d50fd9260994 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:38.611887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e902311-744e-4f25-8ae3-d50fd9260994 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:38.621199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.sql.core [None req-9e902311-744e-4f25-8ae3-d50fd9260994 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 25 01:15:38.621199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 25 01:15:38.621199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [parameters: {'id': '51df146abe4649a7a5220d970985df44', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 25 01:15:38.621199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73335) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 01:15:38.637831 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-9e902311-744e-4f25-8ae3-d50fd9260994 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 25 01:15:38.639837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 193/375] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:15:38 2021] POST /identity/v3/roles => generated 144 bytes in 52 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:38.647262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3fba3-a12c-48c4-9bb8-0eec7aca1613 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:38.656800 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3fba3-a12c-48c4-9bb8-0eec7aca1613 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:38.661667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06ec76-41d9-48d5-9646-897fad0b65d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:38.662715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06ec76-41d9-48d5-9646-897fad0b65d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:38.663286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06ec76-41d9-48d5-9646-897fad0b65d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:38.663787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06ec76-41d9-48d5-9646-897fad0b65d7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:38.675457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06ec76-41d9-48d5-9646-897fad0b65d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:38.683018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-ab06ec76-41d9-48d5-9646-897fad0b65d7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 01:15:38.684448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 183/376] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:15:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:38.690895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902311-744e-4f25-8ae3-d50fd9260994 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:38.702050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902311-744e-4f25-8ae3-d50fd9260994 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:38.706928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0af188-ffef-4393-9398-bc7d08623967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:38.708384 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0af188-ffef-4393-9398-bc7d08623967 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:38.708871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0af188-ffef-4393-9398-bc7d08623967 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:38.709440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0af188-ffef-4393-9398-bc7d08623967 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:38.710397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0af188-ffef-4393-9398-bc7d08623967 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:38.710929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0af188-ffef-4393-9398-bc7d08623967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:38.712801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0af188-ffef-4393-9398-bc7d08623967 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:38.722019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 194/377] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:39.600758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982a802-19c1-4107-bd64-af17b03c3aac None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:39.601729 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982a802-19c1-4107-bd64-af17b03c3aac None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:39.602211 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982a802-19c1-4107-bd64-af17b03c3aac None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:39.604526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 184/378] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:39.610363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726cc23-05f6-4fe4-b9e9-c6c63e55a40f None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:39.611244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726cc23-05f6-4fe4-b9e9-c6c63e55a40f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:39.611726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726cc23-05f6-4fe4-b9e9-c6c63e55a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:39.630508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2726cc23-05f6-4fe4-b9e9-c6c63e55a40f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:39.632060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2726cc23-05f6-4fe4-b9e9-c6c63e55a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:39.640258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 195/379] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:39.670569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982a802-19c1-4107-bd64-af17b03c3aac None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:39.688684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982a802-19c1-4107-bd64-af17b03c3aac None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:39.693503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b260f-d389-4de1-a70a-0e13936b7548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:39.694554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b260f-d389-4de1-a70a-0e13936b7548 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:39.695069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b260f-d389-4de1-a70a-0e13936b7548 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:39.695575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b260f-d389-4de1-a70a-0e13936b7548 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:39.715699 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b260f-d389-4de1-a70a-0e13936b7548 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:39.722488 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-e52b260f-d389-4de1-a70a-0e13936b7548 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:39.724428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 185/380] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:39.730872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726cc23-05f6-4fe4-b9e9-c6c63e55a40f None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:39.740348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726cc23-05f6-4fe4-b9e9-c6c63e55a40f None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:39.752208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cd877-53b6-4a0d-9849-e18a915dcc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:39.752884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cd877-53b6-4a0d-9849-e18a915dcc37 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:39.753210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cd877-53b6-4a0d-9849-e18a915dcc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:39.753493 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cd877-53b6-4a0d-9849-e18a915dcc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:39.754246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cd877-53b6-4a0d-9849-e18a915dcc37 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:39.754661 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cd877-53b6-4a0d-9849-e18a915dcc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:39.756267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cd877-53b6-4a0d-9849-e18a915dcc37 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:39.773914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 196/381] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:39.779872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b260f-d389-4de1-a70a-0e13936b7548 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:39.790123 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b260f-d389-4de1-a70a-0e13936b7548 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:39.802826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c12884-a370-4823-b2c8-c6a63c57e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:39.803614 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c12884-a370-4823-b2c8-c6a63c57e59d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:39.803894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c12884-a370-4823-b2c8-c6a63c57e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:39.804168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c12884-a370-4823-b2c8-c6a63c57e59d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:39.827705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c12884-a370-4823-b2c8-c6a63c57e59d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:39.829560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c12884-a370-4823-b2c8-c6a63c57e59d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:39.855791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-31c12884-a370-4823-b2c8-c6a63c57e59d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:39.857027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 186/382] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:39.863320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cd877-53b6-4a0d-9849-e18a915dcc37 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:39.880877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cd877-53b6-4a0d-9849-e18a915dcc37 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:39.886923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0937236-adb3-4b9b-8efa-a593ee2eab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:39.887744 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0937236-adb3-4b9b-8efa-a593ee2eab37 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:39.888032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0937236-adb3-4b9b-8efa-a593ee2eab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:39.888567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0937236-adb3-4b9b-8efa-a593ee2eab37 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:39.889342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0937236-adb3-4b9b-8efa-a593ee2eab37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:39.889652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0937236-adb3-4b9b-8efa-a593ee2eab37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:39.891352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0937236-adb3-4b9b-8efa-a593ee2eab37 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:39.914713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 197/383] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:39.919966 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c12884-a370-4823-b2c8-c6a63c57e59d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:39.932661 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c12884-a370-4823-b2c8-c6a63c57e59d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:39.948324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe7712-f0b4-419a-b2aa-7ce2a0756ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:39.949168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe7712-f0b4-419a-b2aa-7ce2a0756ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:39.949446 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe7712-f0b4-419a-b2aa-7ce2a0756ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:39.949714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe7712-f0b4-419a-b2aa-7ce2a0756ee2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:39.958939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe7712-f0b4-419a-b2aa-7ce2a0756ee2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:39.960941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe7712-f0b4-419a-b2aa-7ce2a0756ee2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:39.980182 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-20fe7712-f0b4-419a-b2aa-7ce2a0756ee2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 01:15:39.981352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 187/384] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 25 01:15:39 2021] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:39.987623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0937236-adb3-4b9b-8efa-a593ee2eab37 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.003810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0937236-adb3-4b9b-8efa-a593ee2eab37 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.016677 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21cade-c916-45e9-af8a-b291cebc7adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.017356 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21cade-c916-45e9-af8a-b291cebc7adc admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.017638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21cade-c916-45e9-af8a-b291cebc7adc admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.017913 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21cade-c916-45e9-af8a-b291cebc7adc admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.018771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21cade-c916-45e9-af8a-b291cebc7adc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:40.019245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21cade-c916-45e9-af8a-b291cebc7adc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.020281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-4d21cade-c916-45e9-af8a-b291cebc7adc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:40.020281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:40.020281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:40.021436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21cade-c916-45e9-af8a-b291cebc7adc admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.078125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 198/385] 10.222.0.23 () {56 vars in 1155 bytes} [Wed Aug 25 01:15:39 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:40.084235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe7712-f0b4-419a-b2aa-7ce2a0756ee2 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.105188 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe7712-f0b4-419a-b2aa-7ce2a0756ee2 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.119578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7005b-2c4d-477e-8f43-991c2e4309f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.120244 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7005b-2c4d-477e-8f43-991c2e4309f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.120523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7005b-2c4d-477e-8f43-991c2e4309f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.120795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7005b-2c4d-477e-8f43-991c2e4309f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.130911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7005b-2c4d-477e-8f43-991c2e4309f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.132703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7005b-2c4d-477e-8f43-991c2e4309f6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.146798 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 188/386] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:40.149277 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21cade-c916-45e9-af8a-b291cebc7adc admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.168913 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21cade-c916-45e9-af8a-b291cebc7adc admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.173695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819894b-af73-4bd9-bfc7-0eae37c5735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.174761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819894b-af73-4bd9-bfc7-0eae37c5735d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.175272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819894b-af73-4bd9-bfc7-0eae37c5735d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.175748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819894b-af73-4bd9-bfc7-0eae37c5735d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.198237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819894b-af73-4bd9-bfc7-0eae37c5735d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.200426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819894b-af73-4bd9-bfc7-0eae37c5735d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.229452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-b819894b-af73-4bd9-bfc7-0eae37c5735d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:40.231359 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 199/387] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:40.237217 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7005b-2c4d-477e-8f43-991c2e4309f6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.250081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7005b-2c4d-477e-8f43-991c2e4309f6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.252705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b430f5-4e79-46fa-bf40-250683af7dca None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.253213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b430f5-4e79-46fa-bf40-250683af7dca None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.253695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b430f5-4e79-46fa-bf40-250683af7dca None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.256070 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 200/388] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:40.263775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e49d4-2cc1-406d-bd39-5158be5faeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.264429 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e49d4-2cc1-406d-bd39-5158be5faeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.264648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80883-e111-4871-ac26-c021d4225455 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.264749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e49d4-2cc1-406d-bd39-5158be5faeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.264964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e49d4-2cc1-406d-bd39-5158be5faeb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.265446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80883-e111-4871-ac26-c021d4225455 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.265686 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e49d4-2cc1-406d-bd39-5158be5faeb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:40.265997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e49d4-2cc1-406d-bd39-5158be5faeb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.266321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80883-e111-4871-ac26-c021d4225455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.267682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e49d4-2cc1-406d-bd39-5158be5faeb9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.281718 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 189/389] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:40.289201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e49d4-2cc1-406d-bd39-5158be5faeb9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.295730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-67a80883-e111-4871-ac26-c021d4225455 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:40.296952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-67a80883-e111-4871-ac26-c021d4225455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:40.302039 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e49d4-2cc1-406d-bd39-5158be5faeb9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.311437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95315c7-494b-441f-8c83-a18c001ff4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.312240 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95315c7-494b-441f-8c83-a18c001ff4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.312517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95315c7-494b-441f-8c83-a18c001ff4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.312787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95315c7-494b-441f-8c83-a18c001ff4f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.318835 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 201/390] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:40.326563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95315c7-494b-441f-8c83-a18c001ff4f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.328639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95315c7-494b-441f-8c83-a18c001ff4f9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.349467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-d95315c7-494b-441f-8c83-a18c001ff4f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:40.355041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 190/391] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:40.359946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a80883-e111-4871-ac26-c021d4225455 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.375702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a80883-e111-4871-ac26-c021d4225455 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.383961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95315c7-494b-441f-8c83-a18c001ff4f9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.385603 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1aca8-1a1a-4d61-a7c0-4864490cebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.386265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1aca8-1a1a-4d61-a7c0-4864490cebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.386543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1aca8-1a1a-4d61-a7c0-4864490cebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.386839 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1aca8-1a1a-4d61-a7c0-4864490cebe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.387625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1aca8-1a1a-4d61-a7c0-4864490cebe5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:40.387928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1aca8-1a1a-4d61-a7c0-4864490cebe5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.389188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-04b1aca8-1a1a-4d61-a7c0-4864490cebe5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:40.389188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:40.389188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:40.390340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1aca8-1a1a-4d61-a7c0-4864490cebe5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.426821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 202/392] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:40.428544 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdf17d-7f7e-441b-b003-274529de8b19 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.428836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdf17d-7f7e-441b-b003-274529de8b19 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.429117 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdf17d-7f7e-441b-b003-274529de8b19 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.432096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 203/393] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:40.438969 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdf17d-7f7e-441b-b003-274529de8b19 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.452730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdf17d-7f7e-441b-b003-274529de8b19 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.458528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7d0b9-95a6-4700-8938-92862d65ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.459785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d0b9-95a6-4700-8938-92862d65ee5e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.460276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d0b9-95a6-4700-8938-92862d65ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.460757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d0b9-95a6-4700-8938-92862d65ee5e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.461845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7d0b9-95a6-4700-8938-92862d65ee5e admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=d061cf5060334e79ab4f22518d37116f) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:40.462436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7d0b9-95a6-4700-8938-92862d65ee5e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.464692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7d0b9-95a6-4700-8938-92862d65ee5e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.471857 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 204/394] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/role_assignments?user.id=d061cf5060334e79ab4f22518d37116f&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:40.474170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68c013-d12d-4e9a-8304-b6ad0028a44a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.474666 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68c013-d12d-4e9a-8304-b6ad0028a44a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.475212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68c013-d12d-4e9a-8304-b6ad0028a44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.501832 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2c68c013-d12d-4e9a-8304-b6ad0028a44a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:40.504128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2c68c013-d12d-4e9a-8304-b6ad0028a44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:40.532788 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95315c7-494b-441f-8c83-a18c001ff4f9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.538780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826f75e-9450-4d93-8ce3-5c6c52c3dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.540044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826f75e-9450-4d93-8ce3-5c6c52c3dc30 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.540542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826f75e-9450-4d93-8ce3-5c6c52c3dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.541060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826f75e-9450-4d93-8ce3-5c6c52c3dc30 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.548173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 205/395] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:40.561280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826f75e-9450-4d93-8ce3-5c6c52c3dc30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:40.569625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-d826f75e-9450-4d93-8ce3-5c6c52c3dc30 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:40.571212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 191/396] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:40.578872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68c013-d12d-4e9a-8304-b6ad0028a44a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.589661 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826f75e-9450-4d93-8ce3-5c6c52c3dc30 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.600634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826f75e-9450-4d93-8ce3-5c6c52c3dc30 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.601200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68c013-d12d-4e9a-8304-b6ad0028a44a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.606071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83343c3-b7b6-427e-a4a0-8e668a991888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.607779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83343c3-b7b6-427e-a4a0-8e668a991888 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.608294 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83343c3-b7b6-427e-a4a0-8e668a991888 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.608822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83343c3-b7b6-427e-a4a0-8e668a991888 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.621483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83343c3-b7b6-427e-a4a0-8e668a991888 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:40.623443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399962f-b86f-4557-a641-89a8b065f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.624149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399962f-b86f-4557-a641-89a8b065f918 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.624441 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399962f-b86f-4557-a641-89a8b065f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.624718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399962f-b86f-4557-a641-89a8b065f918 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.625487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399962f-b86f-4557-a641-89a8b065f918 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:40.625799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399962f-b86f-4557-a641-89a8b065f918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.627577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399962f-b86f-4557-a641-89a8b065f918 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.631800 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-d83343c3-b7b6-427e-a4a0-8e668a991888 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:40.633721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 192/397] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:40.641794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83343c3-b7b6-427e-a4a0-8e668a991888 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.647605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 206/398] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:40.655911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399962f-b86f-4557-a641-89a8b065f918 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.657912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83343c3-b7b6-427e-a4a0-8e668a991888 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.665964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009618e-9928-4655-8399-c602319f5e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.666121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009618e-9928-4655-8399-c602319f5e92 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.666306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009618e-9928-4655-8399-c602319f5e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.666569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009618e-9928-4655-8399-c602319f5e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.667347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009618e-9928-4655-8399-c602319f5e92 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:40.667649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009618e-9928-4655-8399-c602319f5e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.669224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009618e-9928-4655-8399-c602319f5e92 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.673985 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399962f-b86f-4557-a641-89a8b065f918 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.681263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff851ae-9d6f-476b-938f-766bb7225382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.682522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff851ae-9d6f-476b-938f-766bb7225382 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.683114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff851ae-9d6f-476b-938f-766bb7225382 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.683608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff851ae-9d6f-476b-938f-766bb7225382 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.687947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 193/399] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:40.694156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009618e-9928-4655-8399-c602319f5e92 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.706129 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff851ae-9d6f-476b-938f-766bb7225382 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.708688 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff851ae-9d6f-476b-938f-766bb7225382 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.711071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009618e-9928-4655-8399-c602319f5e92 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.728078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a498a-24fd-4f9c-8785-3972e53d230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.728905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a498a-24fd-4f9c-8785-3972e53d230a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.729186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a498a-24fd-4f9c-8785-3972e53d230a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.729463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a498a-24fd-4f9c-8785-3972e53d230a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.739460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-5ff851ae-9d6f-476b-938f-766bb7225382 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:40.745029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 207/400] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:40.747790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff851ae-9d6f-476b-938f-766bb7225382 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.750331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a498a-24fd-4f9c-8785-3972e53d230a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.752259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a498a-24fd-4f9c-8785-3972e53d230a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.769326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff851ae-9d6f-476b-938f-766bb7225382 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.782164 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-eb3a498a-24fd-4f9c-8785-3972e53d230a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:40.783548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 194/401] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:40.783987 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52e54d-3017-4054-9f20-728c093c5257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.784650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52e54d-3017-4054-9f20-728c093c5257 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.784932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52e54d-3017-4054-9f20-728c093c5257 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.785212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52e54d-3017-4054-9f20-728c093c5257 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.785972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52e54d-3017-4054-9f20-728c093c5257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:40.786279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52e54d-3017-4054-9f20-728c093c5257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.787953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52e54d-3017-4054-9f20-728c093c5257 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.791732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a498a-24fd-4f9c-8785-3972e53d230a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.808439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 208/402] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:40.809472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a498a-24fd-4f9c-8785-3972e53d230a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.814328 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52e54d-3017-4054-9f20-728c093c5257 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.823289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f398a2-2e70-44f9-9f17-6b83578c8081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.824548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f398a2-2e70-44f9-9f17-6b83578c8081 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.824830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f398a2-2e70-44f9-9f17-6b83578c8081 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.825114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f398a2-2e70-44f9-9f17-6b83578c8081 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.826010 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f398a2-2e70-44f9-9f17-6b83578c8081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:40.826385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f398a2-2e70-44f9-9f17-6b83578c8081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.828045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f398a2-2e70-44f9-9f17-6b83578c8081 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.833254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52e54d-3017-4054-9f20-728c093c5257 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.848403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 195/403] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:40.855215 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f398a2-2e70-44f9-9f17-6b83578c8081 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.863521 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffc5a1-078e-4e0a-a508-8f10a2765d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.864547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffc5a1-078e-4e0a-a508-8f10a2765d4a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.864748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffc5a1-078e-4e0a-a508-8f10a2765d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.864958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffc5a1-078e-4e0a-a508-8f10a2765d4a admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.867881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f398a2-2e70-44f9-9f17-6b83578c8081 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.876047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffc5a1-078e-4e0a-a508-8f10a2765d4a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.876047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffc5a1-078e-4e0a-a508-8f10a2765d4a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.885393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e615-4b33-46b7-a2ea-4169887316aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.886198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e615-4b33-46b7-a2ea-4169887316aa admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.886479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e615-4b33-46b7-a2ea-4169887316aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.889362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e615-4b33-46b7-a2ea-4169887316aa admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.903780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8e615-4b33-46b7-a2ea-4169887316aa admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.905782 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8e615-4b33-46b7-a2ea-4169887316aa admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.908035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-a7ffc5a1-078e-4e0a-a508-8f10a2765d4a admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 01:15:40.910847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 209/404] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/users/glance => generated 84 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:40.921696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffc5a1-078e-4e0a-a508-8f10a2765d4a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.932011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffc5a1-078e-4e0a-a508-8f10a2765d4a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.933498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-6db8e615-4b33-46b7-a2ea-4169887316aa admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 01:15:40.935133 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 196/405] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/users/cinder => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:40.936489 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39924b5c-3db8-4a3e-8c18-00533f673035 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.936623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131506f9-eb77-428a-b745-548ac14cbef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.936813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39924b5c-3db8-4a3e-8c18-00533f673035 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.937103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39924b5c-3db8-4a3e-8c18-00533f673035 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.937206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131506f9-eb77-428a-b745-548ac14cbef7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.937418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131506f9-eb77-428a-b745-548ac14cbef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.937695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131506f9-eb77-428a-b745-548ac14cbef7 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.938530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131506f9-eb77-428a-b745-548ac14cbef7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:40.938861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131506f9-eb77-428a-b745-548ac14cbef7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.940715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131506f9-eb77-428a-b745-548ac14cbef7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.944017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 197/406] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:40.944909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39924b5c-3db8-4a3e-8c18-00533f673035 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:40.958317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39924b5c-3db8-4a3e-8c18-00533f673035 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:40.961471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 210/407] 10.222.0.23 () {56 vars in 1159 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:40.962824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44566-5e5c-4053-82c2-a1c567b4725a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.963125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44566-5e5c-4053-82c2-a1c567b4725a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.963403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44566-5e5c-4053-82c2-a1c567b4725a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.968124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0eb09-0969-405d-8c08-ea27638af839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:40.968775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0eb09-0969-405d-8c08-ea27638af839 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:40.969053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0eb09-0969-405d-8c08-ea27638af839 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:40.969369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0eb09-0969-405d-8c08-ea27638af839 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:40.970205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0eb09-0969-405d-8c08-ea27638af839 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:40.970601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0eb09-0969-405d-8c08-ea27638af839 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:40.971682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-f7f0eb09-0969-405d-8c08-ea27638af839 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:40.971682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:40.971682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:40.972915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0eb09-0969-405d-8c08-ea27638af839 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:40.981201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-4ab44566-5e5c-4053-82c2-a1c567b4725a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:40.982401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4ab44566-5e5c-4053-82c2-a1c567b4725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:40.992956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 211/408] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:40.994038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab44566-5e5c-4053-82c2-a1c567b4725a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.016764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab44566-5e5c-4053-82c2-a1c567b4725a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.024871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff3e9c-bd7b-4ecf-afa5-c08bf1a29dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.025405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 198/409] 10.222.0.23 () {56 vars in 1159 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.026164 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0eb09-0969-405d-8c08-ea27638af839 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.026512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff3e9c-bd7b-4ecf-afa5-c08bf1a29dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.031257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff3e9c-bd7b-4ecf-afa5-c08bf1a29dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.031390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff3e9c-bd7b-4ecf-afa5-c08bf1a29dc8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.040543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0eb09-0969-405d-8c08-ea27638af839 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.044598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff3e9c-bd7b-4ecf-afa5-c08bf1a29dc8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.046391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff3e9c-bd7b-4ecf-afa5-c08bf1a29dc8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.047881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f2b4a-5716-4423-b6b0-dfa38f06c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.048958 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f2b4a-5716-4423-b6b0-dfa38f06c087 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.049448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f2b4a-5716-4423-b6b0-dfa38f06c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.049971 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f2b4a-5716-4423-b6b0-dfa38f06c087 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.055912 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 212/410] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:41.061569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff3e9c-bd7b-4ecf-afa5-c08bf1a29dc8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.062306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f2b4a-5716-4423-b6b0-dfa38f06c087 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:41.070398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-522f2b4a-5716-4423-b6b0-dfa38f06c087 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:41.071024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff3e9c-bd7b-4ecf-afa5-c08bf1a29dc8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.072347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 199/411] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:41.073416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f2b4a-5716-4423-b6b0-dfa38f06c087 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.081191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3107b1-85ea-4a59-8127-ae19e7d91a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.081831 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3107b1-85ea-4a59-8127-ae19e7d91a51 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.082113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3107b1-85ea-4a59-8127-ae19e7d91a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.082418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3107b1-85ea-4a59-8127-ae19e7d91a51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.085850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f2b4a-5716-4423-b6b0-dfa38f06c087 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.090783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73fbf6-65d0-4044-a7ef-c1ffc62522db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.091854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73fbf6-65d0-4044-a7ef-c1ffc62522db admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.092338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73fbf6-65d0-4044-a7ef-c1ffc62522db admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.092859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73fbf6-65d0-4044-a7ef-c1ffc62522db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.095319 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3107b1-85ea-4a59-8127-ae19e7d91a51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.097089 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3107b1-85ea-4a59-8127-ae19e7d91a51 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.104741 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73fbf6-65d0-4044-a7ef-c1ffc62522db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.106186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 213/412] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:41.107088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3107b1-85ea-4a59-8127-ae19e7d91a51 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.107398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73fbf6-65d0-4044-a7ef-c1ffc62522db admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.116646 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3107b1-85ea-4a59-8127-ae19e7d91a51 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.121408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49cb3-a37b-4512-83a3-98c2fe5c8a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.122055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49cb3-a37b-4512-83a3-98c2fe5c8a8f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.122336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49cb3-a37b-4512-83a3-98c2fe5c8a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.122611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49cb3-a37b-4512-83a3-98c2fe5c8a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.123385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49cb3-a37b-4512-83a3-98c2fe5c8a8f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.123687 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49cb3-a37b-4512-83a3-98c2fe5c8a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.125263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49cb3-a37b-4512-83a3-98c2fe5c8a8f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.128539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-1d73fbf6-65d0-4044-a7ef-c1ffc62522db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:41.130601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 200/413] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:41.131666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73fbf6-65d0-4044-a7ef-c1ffc62522db admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.140448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 214/414] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.142398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73fbf6-65d0-4044-a7ef-c1ffc62522db admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.143552 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49cb3-a37b-4512-83a3-98c2fe5c8a8f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.150267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127badd4-d444-4535-8bc5-99c545950f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.151356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127badd4-d444-4535-8bc5-99c545950f38 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.151898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127badd4-d444-4535-8bc5-99c545950f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.152379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127badd4-d444-4535-8bc5-99c545950f38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.155897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49cb3-a37b-4512-83a3-98c2fe5c8a8f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.160344 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41602cf4-0e65-4894-bac6-456c14acd7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.161027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41602cf4-0e65-4894-bac6-456c14acd7ba admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.161304 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41602cf4-0e65-4894-bac6-456c14acd7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.161944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41602cf4-0e65-4894-bac6-456c14acd7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.162285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41602cf4-0e65-4894-bac6-456c14acd7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.162588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41602cf4-0e65-4894-bac6-456c14acd7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.164315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41602cf4-0e65-4894-bac6-456c14acd7ba admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.166444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127badd4-d444-4535-8bc5-99c545950f38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.168685 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127badd4-d444-4535-8bc5-99c545950f38 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.176025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 215/415] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.182008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41602cf4-0e65-4894-bac6-456c14acd7ba admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.188033 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-127badd4-d444-4535-8bc5-99c545950f38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:41.189498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 201/416] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:41.190447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127badd4-d444-4535-8bc5-99c545950f38 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.191512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41602cf4-0e65-4894-bac6-456c14acd7ba admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.196638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c73e7e-8a0b-48c6-bbe3-bbd7309e0de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.197406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c73e7e-8a0b-48c6-bbe3-bbd7309e0de5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.197685 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c73e7e-8a0b-48c6-bbe3-bbd7309e0de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.197968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c73e7e-8a0b-48c6-bbe3-bbd7309e0de5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.203495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127badd4-d444-4535-8bc5-99c545950f38 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.208293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c73e7e-8a0b-48c6-bbe3-bbd7309e0de5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.208868 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1705-42a4-467e-af2b-d6af05fb1478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.209895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1705-42a4-467e-af2b-d6af05fb1478 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.210124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c73e7e-8a0b-48c6-bbe3-bbd7309e0de5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.210784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1705-42a4-467e-af2b-d6af05fb1478 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.211111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1705-42a4-467e-af2b-d6af05fb1478 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.218989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1705-42a4-467e-af2b-d6af05fb1478 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.221046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1705-42a4-467e-af2b-d6af05fb1478 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.230704 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-12c73e7e-8a0b-48c6-bbe3-bbd7309e0de5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:41.232185 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 216/417] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:41.233200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c73e7e-8a0b-48c6-bbe3-bbd7309e0de5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.236708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-830b1705-42a4-467e-af2b-d6af05fb1478 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:41.238099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 202/418] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:41.242649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1705-42a4-467e-af2b-d6af05fb1478 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.251715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c73e7e-8a0b-48c6-bbe3-bbd7309e0de5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.256956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832b325-3f39-403f-83f9-d5fb8543e7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.257610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832b325-3f39-403f-83f9-d5fb8543e7ac admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.257891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832b325-3f39-403f-83f9-d5fb8543e7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.258166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832b325-3f39-403f-83f9-d5fb8543e7ac admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.258552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1705-42a4-467e-af2b-d6af05fb1478 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.258923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832b325-3f39-403f-83f9-d5fb8543e7ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.259229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832b325-3f39-403f-83f9-d5fb8543e7ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.260968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832b325-3f39-403f-83f9-d5fb8543e7ac admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.264403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910faec-7923-4a9e-89d3-7edd757cb1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.265273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910faec-7923-4a9e-89d3-7edd757cb1dd admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.265809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910faec-7923-4a9e-89d3-7edd757cb1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.266298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910faec-7923-4a9e-89d3-7edd757cb1dd admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.267347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910faec-7923-4a9e-89d3-7edd757cb1dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.267862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910faec-7923-4a9e-89d3-7edd757cb1dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.269829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910faec-7923-4a9e-89d3-7edd757cb1dd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.277737 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 217/419] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.282585 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 203/420] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.284246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910faec-7923-4a9e-89d3-7edd757cb1dd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.286816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832b325-3f39-403f-83f9-d5fb8543e7ac admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.295146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910faec-7923-4a9e-89d3-7edd757cb1dd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.297315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832b325-3f39-403f-83f9-d5fb8543e7ac admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.301051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da7dd7-8158-4d39-941c-dc72d6052c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.302413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9c577-0d71-458c-a0bb-fbf68025af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.303089 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c577-0d71-458c-a0bb-fbf68025af2d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.303375 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c577-0d71-458c-a0bb-fbf68025af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.303657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c577-0d71-458c-a0bb-fbf68025af2d admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.303969 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da7dd7-8158-4d39-941c-dc72d6052c66 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.304433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9c577-0d71-458c-a0bb-fbf68025af2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.304732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9c577-0d71-458c-a0bb-fbf68025af2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.305160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da7dd7-8158-4d39-941c-dc72d6052c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.305881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da7dd7-8158-4d39-941c-dc72d6052c66 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.306593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9c577-0d71-458c-a0bb-fbf68025af2d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.314115 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da7dd7-8158-4d39-941c-dc72d6052c66 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.316376 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da7dd7-8158-4d39-941c-dc72d6052c66 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.319461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 218/421] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.325537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9c577-0d71-458c-a0bb-fbf68025af2d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.332783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-36da7dd7-8158-4d39-941c-dc72d6052c66 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:41.334515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 204/422] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:41.335454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9c577-0d71-458c-a0bb-fbf68025af2d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.335740 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da7dd7-8158-4d39-941c-dc72d6052c66 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.340302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19395340-17d3-437e-833f-e53bc011634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.341038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19395340-17d3-437e-833f-e53bc011634c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.341321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19395340-17d3-437e-833f-e53bc011634c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.341598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19395340-17d3-437e-833f-e53bc011634c admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.348700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da7dd7-8158-4d39-941c-dc72d6052c66 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.350099 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19395340-17d3-437e-833f-e53bc011634c admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.352177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19395340-17d3-437e-833f-e53bc011634c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.354824 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4a938-ac86-4fbe-b91b-652f00a61545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.355808 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4a938-ac86-4fbe-b91b-652f00a61545 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.356356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4a938-ac86-4fbe-b91b-652f00a61545 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.356833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4a938-ac86-4fbe-b91b-652f00a61545 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.357922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4a938-ac86-4fbe-b91b-652f00a61545 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=c0b9d35e26e64c959e075622321df3a4) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.358438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4a938-ac86-4fbe-b91b-652f00a61545 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.360643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4a938-ac86-4fbe-b91b-652f00a61545 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.366289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-19395340-17d3-437e-833f-e53bc011634c admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 01:15:41.367696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 219/423] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/users/neutron => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:41.368543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 205/424] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/role_assignments?user.id=c0b9d35e26e64c959e075622321df3a4&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.371427 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19395340-17d3-437e-833f-e53bc011634c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.378267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4a938-ac86-4fbe-b91b-652f00a61545 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.393042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19395340-17d3-437e-833f-e53bc011634c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.394349 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4a938-ac86-4fbe-b91b-652f00a61545 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.404891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be4e9d-7787-48dd-b48c-82f900e10a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.405302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b92ebb-41d3-423a-83f2-6638693096e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.406356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92ebb-41d3-423a-83f2-6638693096e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.407477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be4e9d-7787-48dd-b48c-82f900e10a27 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.408030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92ebb-41d3-423a-83f2-6638693096e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.408560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be4e9d-7787-48dd-b48c-82f900e10a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.409081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92ebb-41d3-423a-83f2-6638693096e7 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.409574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be4e9d-7787-48dd-b48c-82f900e10a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.411745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be4e9d-7787-48dd-b48c-82f900e10a27 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.411886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b92ebb-41d3-423a-83f2-6638693096e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.412105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b92ebb-41d3-423a-83f2-6638693096e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.412719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be4e9d-7787-48dd-b48c-82f900e10a27 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.414051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b92ebb-41d3-423a-83f2-6638693096e7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.415344 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be4e9d-7787-48dd-b48c-82f900e10a27 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.440622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 220/425] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.449018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 206/426] 10.222.0.23 () {56 vars in 1161 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:41.450064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be4e9d-7787-48dd-b48c-82f900e10a27 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.455207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b92ebb-41d3-423a-83f2-6638693096e7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.467314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b92ebb-41d3-423a-83f2-6638693096e7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.470073 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be4e9d-7787-48dd-b48c-82f900e10a27 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.477949 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574625ed-5c0a-45c4-b970-cc5ac1013aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.478617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574625ed-5c0a-45c4-b970-cc5ac1013aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.478927 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574625ed-5c0a-45c4-b970-cc5ac1013aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.479201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574625ed-5c0a-45c4-b970-cc5ac1013aa4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.480658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93569-251a-4fd1-8795-d2139a00b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.481341 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93569-251a-4fd1-8795-d2139a00b0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.481618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93569-251a-4fd1-8795-d2139a00b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.481886 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93569-251a-4fd1-8795-d2139a00b0d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.483351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a93569-251a-4fd1-8795-d2139a00b0d1 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=1dde8359945b45bbbf5d3a27964a7f5b) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.483660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a93569-251a-4fd1-8795-d2139a00b0d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.485561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a93569-251a-4fd1-8795-d2139a00b0d1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.497398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 221/427] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/role_assignments?user.id=1dde8359945b45bbbf5d3a27964a7f5b&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.497609 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574625ed-5c0a-45c4-b970-cc5ac1013aa4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.498773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af72b-8d2a-497e-93b0-fba3e49a6369 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.499070 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af72b-8d2a-497e-93b0-fba3e49a6369 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.499349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af72b-8d2a-497e-93b0-fba3e49a6369 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.499450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574625ed-5c0a-45c4-b970-cc5ac1013aa4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.501024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 222/428] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:41.512049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038c0cf-9e36-4bb8-a58f-76a8a5b42276 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.512407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038c0cf-9e36-4bb8-a58f-76a8a5b42276 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.512749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038c0cf-9e36-4bb8-a58f-76a8a5b42276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.522078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 207/429] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:15:41.529026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574625ed-5c0a-45c4-b970-cc5ac1013aa4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.544307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d038c0cf-9e36-4bb8-a58f-76a8a5b42276 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:41.545667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d038c0cf-9e36-4bb8-a58f-76a8a5b42276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:41.548913 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574625ed-5c0a-45c4-b970-cc5ac1013aa4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.554643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 223/430] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:41.564419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d092f5-21e7-45a7-a5cc-7514a185e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.565219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d092f5-21e7-45a7-a5cc-7514a185e70f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.565500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d092f5-21e7-45a7-a5cc-7514a185e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.565773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d092f5-21e7-45a7-a5cc-7514a185e70f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.581537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038c0cf-9e36-4bb8-a58f-76a8a5b42276 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.590925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038c0cf-9e36-4bb8-a58f-76a8a5b42276 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.593388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d092f5-21e7-45a7-a5cc-7514a185e70f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.595651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48de29-e2c9-4c0d-a45e-2d61416edaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.595926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d092f5-21e7-45a7-a5cc-7514a185e70f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.596537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48de29-e2c9-4c0d-a45e-2d61416edaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.596815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48de29-e2c9-4c0d-a45e-2d61416edaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.597091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48de29-e2c9-4c0d-a45e-2d61416edaf4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.610229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48de29-e2c9-4c0d-a45e-2d61416edaf4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.612217 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48de29-e2c9-4c0d-a45e-2d61416edaf4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.617327 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-d9d092f5-21e7-45a7-a5cc-7514a185e70f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:41.618573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 208/431] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:41.629467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d092f5-21e7-45a7-a5cc-7514a185e70f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.639865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d092f5-21e7-45a7-a5cc-7514a185e70f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.647747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-cb48de29-e2c9-4c0d-a45e-2d61416edaf4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:41.649022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 224/432] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:41.656007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48de29-e2c9-4c0d-a45e-2d61416edaf4 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.657397 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe05c-cf2a-4829-92e9-58ea5132c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.658069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe05c-cf2a-4829-92e9-58ea5132c239 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.658351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe05c-cf2a-4829-92e9-58ea5132c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.658632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fe05c-cf2a-4829-92e9-58ea5132c239 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.659398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fe05c-cf2a-4829-92e9-58ea5132c239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.659711 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fe05c-cf2a-4829-92e9-58ea5132c239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.663235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fe05c-cf2a-4829-92e9-58ea5132c239 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.680722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48de29-e2c9-4c0d-a45e-2d61416edaf4 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.689572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 209/433] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.695391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e762f-c6eb-41b5-8763-590f9662a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.696139 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e762f-c6eb-41b5-8763-590f9662a602 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.696420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e762f-c6eb-41b5-8763-590f9662a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.696694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e762f-c6eb-41b5-8763-590f9662a602 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.697494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e762f-c6eb-41b5-8763-590f9662a602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.697798 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e762f-c6eb-41b5-8763-590f9662a602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.699592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e762f-c6eb-41b5-8763-590f9662a602 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.712321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe05c-cf2a-4829-92e9-58ea5132c239 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.724822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fe05c-cf2a-4829-92e9-58ea5132c239 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.725355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 225/434] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:41.734472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e762f-c6eb-41b5-8763-590f9662a602 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.736222 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c5a93-5fcb-420f-b355-a432a34f13e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.737007 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c5a93-5fcb-420f-b355-a432a34f13e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.737288 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c5a93-5fcb-420f-b355-a432a34f13e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.737560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c5a93-5fcb-420f-b355-a432a34f13e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.747077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e762f-c6eb-41b5-8763-590f9662a602 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.748822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c5a93-5fcb-420f-b355-a432a34f13e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.751363 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c5a93-5fcb-420f-b355-a432a34f13e8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.764237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad8375-2df2-49ab-98ed-bc219152a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.764922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad8375-2df2-49ab-98ed-bc219152a67d admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.765204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad8375-2df2-49ab-98ed-bc219152a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.765473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad8375-2df2-49ab-98ed-bc219152a67d admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.766175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad8375-2df2-49ab-98ed-bc219152a67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.768106 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad8375-2df2-49ab-98ed-bc219152a67d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.768748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-994c5a93-5fcb-420f-b355-a432a34f13e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:41.770843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 210/435] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:41.781071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c5a93-5fcb-420f-b355-a432a34f13e8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.791869 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c5a93-5fcb-420f-b355-a432a34f13e8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.797111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a76dc9-1b61-4793-a745-14fdf30e06f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.798050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a76dc9-1b61-4793-a745-14fdf30e06f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.798597 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a76dc9-1b61-4793-a745-14fdf30e06f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.799110 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a76dc9-1b61-4793-a745-14fdf30e06f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.800140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a76dc9-1b61-4793-a745-14fdf30e06f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.800636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a76dc9-1b61-4793-a745-14fdf30e06f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.802024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-f5a76dc9-1b61-4793-a745-14fdf30e06f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:41.802024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:41.802024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:41.803756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a76dc9-1b61-4793-a745-14fdf30e06f6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.812385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 226/436] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:15:41 2021] POST /identity/v3/users => generated 247 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:41.825951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 211/437] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:41.833694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad8375-2df2-49ab-98ed-bc219152a67d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:41.845255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad8375-2df2-49ab-98ed-bc219152a67d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:41.851160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc2c3f-c81b-4c6c-9ad8-67973e5075fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:41.852156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc2c3f-c81b-4c6c-9ad8-67973e5075fe admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:41.852594 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc2c3f-c81b-4c6c-9ad8-67973e5075fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:41.853086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc2c3f-c81b-4c6c-9ad8-67973e5075fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:41.854121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc2c3f-c81b-4c6c-9ad8-67973e5075fe admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=a08ace1a65c040bf97108a1660f962ee) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:41.854627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc2c3f-c81b-4c6c-9ad8-67973e5075fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:41.856810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc2c3f-c81b-4c6c-9ad8-67973e5075fe admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:41.863431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 227/438] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:41 2021] GET /identity/v3/role_assignments?user.id=a08ace1a65c040bf97108a1660f962ee&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:42.848767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c13f69-e46e-4579-8f96-2df2be19acdc None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:42.849290 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c13f69-e46e-4579-8f96-2df2be19acdc None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:42.849482 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c13f69-e46e-4579-8f96-2df2be19acdc None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:42.851656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 212/439] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:42.857339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b38ef4-13c1-4bb2-ab2f-6c652e42b410 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:42.857782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b38ef4-13c1-4bb2-ab2f-6c652e42b410 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:42.857931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b38ef4-13c1-4bb2-ab2f-6c652e42b410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:42.886712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-16b38ef4-13c1-4bb2-ab2f-6c652e42b410 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:42.887924 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-16b38ef4-13c1-4bb2-ab2f-6c652e42b410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:42.902037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 228/440] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:42.938126 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c13f69-e46e-4579-8f96-2df2be19acdc None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:42.952297 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c13f69-e46e-4579-8f96-2df2be19acdc None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:42.956761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1292-75c9-4358-95ee-f8104398b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:42.957580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1292-75c9-4358-95ee-f8104398b91c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:42.957864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1292-75c9-4358-95ee-f8104398b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:42.958141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1292-75c9-4358-95ee-f8104398b91c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:42.971150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1292-75c9-4358-95ee-f8104398b91c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:42.978378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-15de1292-75c9-4358-95ee-f8104398b91c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:42.979735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 213/441] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:42.986183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b38ef4-13c1-4bb2-ab2f-6c652e42b410 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:42.999887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b38ef4-13c1-4bb2-ab2f-6c652e42b410 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:43.010764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162bac8-c0a2-4a71-96f0-3acf151016eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:43.011435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162bac8-c0a2-4a71-96f0-3acf151016eb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.011722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162bac8-c0a2-4a71-96f0-3acf151016eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.011988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162bac8-c0a2-4a71-96f0-3acf151016eb admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.012733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162bac8-c0a2-4a71-96f0-3acf151016eb admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:43.013042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162bac8-c0a2-4a71-96f0-3acf151016eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:43.014916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162bac8-c0a2-4a71-96f0-3acf151016eb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:43.028725 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 229/442] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:43.035047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1292-75c9-4358-95ee-f8104398b91c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:43.053356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1292-75c9-4358-95ee-f8104398b91c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:43.062755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70858c-178d-4673-967b-ad7124f7b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:43.063540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70858c-178d-4673-967b-ad7124f7b42c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.063818 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70858c-178d-4673-967b-ad7124f7b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.064091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70858c-178d-4673-967b-ad7124f7b42c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.078223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70858c-178d-4673-967b-ad7124f7b42c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:43.080414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70858c-178d-4673-967b-ad7124f7b42c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:43.101783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-6e70858c-178d-4673-967b-ad7124f7b42c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:43.103293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 214/443] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:43.109558 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162bac8-c0a2-4a71-96f0-3acf151016eb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:43.123643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162bac8-c0a2-4a71-96f0-3acf151016eb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:43.130781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef74ddd-614e-453d-8862-61fea76d4b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:43.131444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef74ddd-614e-453d-8862-61fea76d4b3a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.131728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef74ddd-614e-453d-8862-61fea76d4b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.132004 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef74ddd-614e-453d-8862-61fea76d4b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.132726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef74ddd-614e-453d-8862-61fea76d4b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:43.133035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef74ddd-614e-453d-8862-61fea76d4b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:43.134644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef74ddd-614e-453d-8862-61fea76d4b3a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:43.152171 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 230/444] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:43.158234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70858c-178d-4673-967b-ad7124f7b42c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:43.171637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70858c-178d-4673-967b-ad7124f7b42c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:43.177036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc60afc-c14f-4b4c-bcec-930a1bbf6b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:43.178106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc60afc-c14f-4b4c-bcec-930a1bbf6b14 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.178595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc60afc-c14f-4b4c-bcec-930a1bbf6b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.179174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc60afc-c14f-4b4c-bcec-930a1bbf6b14 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.195578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc60afc-c14f-4b4c-bcec-930a1bbf6b14 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:43.197933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc60afc-c14f-4b4c-bcec-930a1bbf6b14 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:43.214717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-edc60afc-c14f-4b4c-bcec-930a1bbf6b14 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 01:15:43.220974 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 215/445] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 25 01:15:43 2021] GET /identity/v3/users/nova => generated 82 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:43.222195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef74ddd-614e-453d-8862-61fea76d4b3a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:43.244921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef74ddd-614e-453d-8862-61fea76d4b3a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:43.259594 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf67ed-5e16-4180-82d1-f67bf59d703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:43.260302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf67ed-5e16-4180-82d1-f67bf59d703b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.260589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf67ed-5e16-4180-82d1-f67bf59d703b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.260865 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf67ed-5e16-4180-82d1-f67bf59d703b admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.261725 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf67ed-5e16-4180-82d1-f67bf59d703b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:43.262036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf67ed-5e16-4180-82d1-f67bf59d703b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:43.264194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf67ed-5e16-4180-82d1-f67bf59d703b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:43.294233 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 231/446] 10.222.0.23 () {56 vars in 1155 bytes} [Wed Aug 25 01:15:43 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:43.300164 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc60afc-c14f-4b4c-bcec-930a1bbf6b14 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:43.315690 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc60afc-c14f-4b4c-bcec-930a1bbf6b14 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:43.327882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56990140-a7c7-4e79-9929-18e11e591ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:43.328665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56990140-a7c7-4e79-9929-18e11e591ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.328945 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56990140-a7c7-4e79-9929-18e11e591ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.329217 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56990140-a7c7-4e79-9929-18e11e591ab9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.346417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56990140-a7c7-4e79-9929-18e11e591ab9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:43.348349 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56990140-a7c7-4e79-9929-18e11e591ab9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:43.377101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-56990140-a7c7-4e79-9929-18e11e591ab9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:43.378213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 216/447] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:43.385045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf67ed-5e16-4180-82d1-f67bf59d703b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:43.399702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf67ed-5e16-4180-82d1-f67bf59d703b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:43.411327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bc48b-2d74-4c76-bd4d-116ef7ebb68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:43.412006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bc48b-2d74-4c76-bd4d-116ef7ebb68f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.412292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bc48b-2d74-4c76-bd4d-116ef7ebb68f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.412572 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bc48b-2d74-4c76-bd4d-116ef7ebb68f admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.413298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bc48b-2d74-4c76-bd4d-116ef7ebb68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:43.413605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bc48b-2d74-4c76-bd4d-116ef7ebb68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:43.415229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bc48b-2d74-4c76-bd4d-116ef7ebb68f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:43.431657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 232/448] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:43.438173 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56990140-a7c7-4e79-9929-18e11e591ab9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:43.451642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56990140-a7c7-4e79-9929-18e11e591ab9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:43.456072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061e97f-0687-41b3-9e3b-d8a3a4bc5148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:43.456844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061e97f-0687-41b3-9e3b-d8a3a4bc5148 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.457123 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061e97f-0687-41b3-9e3b-d8a3a4bc5148 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.457424 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061e97f-0687-41b3-9e3b-d8a3a4bc5148 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.464343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061e97f-0687-41b3-9e3b-d8a3a4bc5148 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:43.466305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061e97f-0687-41b3-9e3b-d8a3a4bc5148 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:43.479120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-a061e97f-0687-41b3-9e3b-d8a3a4bc5148 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:43.480629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 217/449] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:43.486838 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bc48b-2d74-4c76-bd4d-116ef7ebb68f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:43.509167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bc48b-2d74-4c76-bd4d-116ef7ebb68f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:43.524216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4a80f-d153-4795-ad9a-27a0023b8f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:43.524885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4a80f-d153-4795-ad9a-27a0023b8f34 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.525170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4a80f-d153-4795-ad9a-27a0023b8f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.525449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4a80f-d153-4795-ad9a-27a0023b8f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.526240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4a80f-d153-4795-ad9a-27a0023b8f34 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:43.526551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4a80f-d153-4795-ad9a-27a0023b8f34 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:43.528433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4a80f-d153-4795-ad9a-27a0023b8f34 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:43.552045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 233/450] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:43.558701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061e97f-0687-41b3-9e3b-d8a3a4bc5148 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:43.572139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061e97f-0687-41b3-9e3b-d8a3a4bc5148 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:43.587389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a66e8-f2d2-4a02-94e5-17caf58cdad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:43.588285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a66e8-f2d2-4a02-94e5-17caf58cdad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.588569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a66e8-f2d2-4a02-94e5-17caf58cdad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.588845 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a66e8-f2d2-4a02-94e5-17caf58cdad9 admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/d061cf5060334e79ab4f22518d37116f/roles/a7290d45b88b4a14ab8a17f724c7adf9` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.616121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a66e8-f2d2-4a02-94e5-17caf58cdad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=d061cf5060334e79ab4f22518d37116f, role_id=a7290d45b88b4a14ab8a17f724c7adf9)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:43.618803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a66e8-f2d2-4a02-94e5-17caf58cdad9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:43.643869 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 218/451] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:43 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/d061cf5060334e79ab4f22518d37116f/roles/a7290d45b88b4a14ab8a17f724c7adf9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:43.943407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aa753-cafd-494a-88bb-3370ddebce55 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.943407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aa753-cafd-494a-88bb-3370ddebce55 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.943407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aa753-cafd-494a-88bb-3370ddebce55 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.944672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 234/452] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:43.949414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399bb1c-803e-4b86-8c43-62f2372d3182 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:43.949918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399bb1c-803e-4b86-8c43-62f2372d3182 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:43.950074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399bb1c-803e-4b86-8c43-62f2372d3182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:43.972440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-3399bb1c-803e-4b86-8c43-62f2372d3182 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:43.974201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3399bb1c-803e-4b86-8c43-62f2372d3182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:44.040897 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 219/453] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:44.084336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719aa753-cafd-494a-88bb-3370ddebce55 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.098732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719aa753-cafd-494a-88bb-3370ddebce55 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.103990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb22932-1a68-4d36-bf9d-dc195923baf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.105251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb22932-1a68-4d36-bf9d-dc195923baf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.105772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb22932-1a68-4d36-bf9d-dc195923baf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.106306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb22932-1a68-4d36-bf9d-dc195923baf7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.125621 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb22932-1a68-4d36-bf9d-dc195923baf7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:44.133487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-acb22932-1a68-4d36-bf9d-dc195923baf7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:44.135388 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 235/454] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:44.141804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399bb1c-803e-4b86-8c43-62f2372d3182 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.152086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399bb1c-803e-4b86-8c43-62f2372d3182 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.156942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb053c-8b63-41b2-aa69-a1a138c46ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.157854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb053c-8b63-41b2-aa69-a1a138c46ddb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.158390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb053c-8b63-41b2-aa69-a1a138c46ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.158922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb053c-8b63-41b2-aa69-a1a138c46ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.159941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb053c-8b63-41b2-aa69-a1a138c46ddb admin admin] RBAC: Adding query filter params (name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:44.160515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb053c-8b63-41b2-aa69-a1a138c46ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.162933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb053c-8b63-41b2-aa69-a1a138c46ddb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.172497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 220/455] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:44.178441 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb22932-1a68-4d36-bf9d-dc195923baf7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.188914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb22932-1a68-4d36-bf9d-dc195923baf7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.193919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12e3c8-6b86-4e1d-a46b-ec4251aaf643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.195007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12e3c8-6b86-4e1d-a46b-ec4251aaf643 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.195500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12e3c8-6b86-4e1d-a46b-ec4251aaf643 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.196055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12e3c8-6b86-4e1d-a46b-ec4251aaf643 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.213151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12e3c8-6b86-4e1d-a46b-ec4251aaf643 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.215454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12e3c8-6b86-4e1d-a46b-ec4251aaf643 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.236360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-3a12e3c8-6b86-4e1d-a46b-ec4251aaf643 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:44.237877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 236/456] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:44.242281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7460c-8095-43f9-a623-e9d8886b1a1b None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.242898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7460c-8095-43f9-a623-e9d8886b1a1b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.243385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7460c-8095-43f9-a623-e9d8886b1a1b None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.245480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 221/457] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:44.246560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12e3c8-6b86-4e1d-a46b-ec4251aaf643 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.258660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12e3c8-6b86-4e1d-a46b-ec4251aaf643 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.260786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe146-6820-45f3-b956-64cd2a622d41 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.261402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe146-6820-45f3-b956-64cd2a622d41 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.261954 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe146-6820-45f3-b956-64cd2a622d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.263825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818c33a-1e6d-4dca-81af-da7fd7d709c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.264484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818c33a-1e6d-4dca-81af-da7fd7d709c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.264766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818c33a-1e6d-4dca-81af-da7fd7d709c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.265136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818c33a-1e6d-4dca-81af-da7fd7d709c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.265849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818c33a-1e6d-4dca-81af-da7fd7d709c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:44.266196 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818c33a-1e6d-4dca-81af-da7fd7d709c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.267903 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818c33a-1e6d-4dca-81af-da7fd7d709c1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.286819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 237/458] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:44.288237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818c33a-1e6d-4dca-81af-da7fd7d709c1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.297783 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818c33a-1e6d-4dca-81af-da7fd7d709c1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.299696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-10cfe146-6820-45f3-b956-64cd2a622d41 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:44.301932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-10cfe146-6820-45f3-b956-64cd2a622d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:44.304493 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7a9ee-eb2b-4da0-8c6b-d362b76f95b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.305335 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7a9ee-eb2b-4da0-8c6b-d362b76f95b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.305616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7a9ee-eb2b-4da0-8c6b-d362b76f95b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.305891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7a9ee-eb2b-4da0-8c6b-d362b76f95b8 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.313941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7a9ee-eb2b-4da0-8c6b-d362b76f95b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.316045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7a9ee-eb2b-4da0-8c6b-d362b76f95b8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.324309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 222/459] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:44.335466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-f4a7a9ee-eb2b-4da0-8c6b-d362b76f95b8 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 01:15:44.343120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 238/460] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/users/glance => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:44.351722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe146-6820-45f3-b956-64cd2a622d41 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.362988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7a9ee-eb2b-4da0-8c6b-d362b76f95b8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.366333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe146-6820-45f3-b956-64cd2a622d41 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.373175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7a9ee-eb2b-4da0-8c6b-d362b76f95b8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.377933 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c008cd8-a3ab-4947-90af-fd3af790ba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.378765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c008cd8-a3ab-4947-90af-fd3af790ba25 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.379054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c008cd8-a3ab-4947-90af-fd3af790ba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.379914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c008cd8-a3ab-4947-90af-fd3af790ba25 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.383343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ced153-68e4-4aa0-94ba-068fd2edee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.385085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ced153-68e4-4aa0-94ba-068fd2edee9d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.385364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ced153-68e4-4aa0-94ba-068fd2edee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.386750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ced153-68e4-4aa0-94ba-068fd2edee9d admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.387606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ced153-68e4-4aa0-94ba-068fd2edee9d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:44.388462 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ced153-68e4-4aa0-94ba-068fd2edee9d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.391018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ced153-68e4-4aa0-94ba-068fd2edee9d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.401022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c008cd8-a3ab-4947-90af-fd3af790ba25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:44.410448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-6c008cd8-a3ab-4947-90af-fd3af790ba25 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:44.422164 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 239/461] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:44.424120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c008cd8-a3ab-4947-90af-fd3af790ba25 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.430274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 223/462] 10.222.0.23 () {56 vars in 1159 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:44.439974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c008cd8-a3ab-4947-90af-fd3af790ba25 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.447235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ced153-68e4-4aa0-94ba-068fd2edee9d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.453708 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f97f1a-d685-4622-a2ab-4b26e8b8dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.454193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f97f1a-d685-4622-a2ab-4b26e8b8dfcd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.454476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f97f1a-d685-4622-a2ab-4b26e8b8dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.455908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f97f1a-d685-4622-a2ab-4b26e8b8dfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.459650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ced153-68e4-4aa0-94ba-068fd2edee9d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.460333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f97f1a-d685-4622-a2ab-4b26e8b8dfcd admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:44.460706 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f97f1a-d685-4622-a2ab-4b26e8b8dfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.463297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f97f1a-d685-4622-a2ab-4b26e8b8dfcd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.468234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca80063-d888-41a2-8e56-cf0a0f5af09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.469085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca80063-d888-41a2-8e56-cf0a0f5af09c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.469365 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca80063-d888-41a2-8e56-cf0a0f5af09c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.470738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca80063-d888-41a2-8e56-cf0a0f5af09c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.495073 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 240/463] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:44.497070 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f97f1a-d685-4622-a2ab-4b26e8b8dfcd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.500304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca80063-d888-41a2-8e56-cf0a0f5af09c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.502365 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca80063-d888-41a2-8e56-cf0a0f5af09c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.514494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f97f1a-d685-4622-a2ab-4b26e8b8dfcd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.531340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eaa31-b0cc-4dc4-8639-50496ba333b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.532146 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eaa31-b0cc-4dc4-8639-50496ba333b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.532385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-cca80063-d888-41a2-8e56-cf0a0f5af09c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:44.532492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eaa31-b0cc-4dc4-8639-50496ba333b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.532692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eaa31-b0cc-4dc4-8639-50496ba333b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.538790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 224/464] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:44.540042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca80063-d888-41a2-8e56-cf0a0f5af09c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.543965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301eaa31-b0cc-4dc4-8639-50496ba333b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.545829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301eaa31-b0cc-4dc4-8639-50496ba333b3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.549844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca80063-d888-41a2-8e56-cf0a0f5af09c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.555199 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73623ae6-a8f5-41c7-9162-01e383702993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.555844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73623ae6-a8f5-41c7-9162-01e383702993 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.556397 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73623ae6-a8f5-41c7-9162-01e383702993 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.556682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73623ae6-a8f5-41c7-9162-01e383702993 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.557403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73623ae6-a8f5-41c7-9162-01e383702993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:44.557708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73623ae6-a8f5-41c7-9162-01e383702993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.559317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73623ae6-a8f5-41c7-9162-01e383702993 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.563822 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-301eaa31-b0cc-4dc4-8639-50496ba333b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:44.565355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 241/465] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:44.566618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd7310-7918-4028-bdf6-ee5d2c22a497 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.567443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd7310-7918-4028-bdf6-ee5d2c22a497 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.567723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd7310-7918-4028-bdf6-ee5d2c22a497 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.569580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 242/466] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:44.575213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7885b3-7639-4173-b265-4837fb443a7a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.575505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7885b3-7639-4173-b265-4837fb443a7a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.575791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7885b3-7639-4173-b265-4837fb443a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.576557 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 225/467] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:44.577495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73623ae6-a8f5-41c7-9162-01e383702993 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.593711 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73623ae6-a8f5-41c7-9162-01e383702993 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.594919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-5d7885b3-7639-4173-b265-4837fb443a7a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:44.596397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5d7885b3-7639-4173-b265-4837fb443a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:44.598140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e40f1-7c0c-4f3a-81f8-eb87b57d7ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.598907 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e40f1-7c0c-4f3a-81f8-eb87b57d7ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.599191 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e40f1-7c0c-4f3a-81f8-eb87b57d7ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.599477 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e40f1-7c0c-4f3a-81f8-eb87b57d7ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.600183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e40f1-7c0c-4f3a-81f8-eb87b57d7ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:44.600489 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e40f1-7c0c-4f3a-81f8-eb87b57d7ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.602150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e40f1-7c0c-4f3a-81f8-eb87b57d7ea4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.606522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 243/468] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:44.614695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7885b3-7639-4173-b265-4837fb443a7a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.614816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 226/469] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:44.620426 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e40f1-7c0c-4f3a-81f8-eb87b57d7ea4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.631103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e40f1-7c0c-4f3a-81f8-eb87b57d7ea4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.635241 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7885b3-7639-4173-b265-4837fb443a7a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.641137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e81b8-6dae-4295-b051-e4174842c168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.641931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e81b8-6dae-4295-b051-e4174842c168 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.642216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e81b8-6dae-4295-b051-e4174842c168 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.642490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e81b8-6dae-4295-b051-e4174842c168 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.646117 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d594651-3680-456d-a33b-be2f92641c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.647142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d594651-3680-456d-a33b-be2f92641c6e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.647441 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d594651-3680-456d-a33b-be2f92641c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.647783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d594651-3680-456d-a33b-be2f92641c6e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.653614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e81b8-6dae-4295-b051-e4174842c168 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.656022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e81b8-6dae-4295-b051-e4174842c168 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.656150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d594651-3680-456d-a33b-be2f92641c6e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.658264 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d594651-3680-456d-a33b-be2f92641c6e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.670576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-432e81b8-6dae-4295-b051-e4174842c168 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:44.672041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 244/470] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:44.672965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-1d594651-3680-456d-a33b-be2f92641c6e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 01:15:44.673265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e81b8-6dae-4295-b051-e4174842c168 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.674465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 227/471] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:44.683519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d594651-3680-456d-a33b-be2f92641c6e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.687873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e81b8-6dae-4295-b051-e4174842c168 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.693799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300c0e9-a93b-4c1b-aab8-4a86fed9fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.694887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c0e9-a93b-4c1b-aab8-4a86fed9fe09 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.695182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c0e9-a93b-4c1b-aab8-4a86fed9fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.695462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c0e9-a93b-4c1b-aab8-4a86fed9fe09 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.696925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d594651-3680-456d-a33b-be2f92641c6e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.701637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb8c7a-88cc-43db-8ca8-82b05998f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.702330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb8c7a-88cc-43db-8ca8-82b05998f249 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.702617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb8c7a-88cc-43db-8ca8-82b05998f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.702931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb8c7a-88cc-43db-8ca8-82b05998f249 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.703783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb8c7a-88cc-43db-8ca8-82b05998f249 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:44.704096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb8c7a-88cc-43db-8ca8-82b05998f249 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.706090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb8c7a-88cc-43db-8ca8-82b05998f249 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.706858 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300c0e9-a93b-4c1b-aab8-4a86fed9fe09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:44.715679 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-8300c0e9-a93b-4c1b-aab8-4a86fed9fe09 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:44.717847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 245/472] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:44.718628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300c0e9-a93b-4c1b-aab8-4a86fed9fe09 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.719481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 228/473] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:44.725531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb8c7a-88cc-43db-8ca8-82b05998f249 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.736392 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb8c7a-88cc-43db-8ca8-82b05998f249 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.741137 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a9df-fe7a-439b-af21-2a8e57b35e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.741712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300c0e9-a93b-4c1b-aab8-4a86fed9fe09 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.741822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a9df-fe7a-439b-af21-2a8e57b35e05 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.742063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a9df-fe7a-439b-af21-2a8e57b35e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.742346 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884a9df-fe7a-439b-af21-2a8e57b35e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.743153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884a9df-fe7a-439b-af21-2a8e57b35e05 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:44.743466 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884a9df-fe7a-439b-af21-2a8e57b35e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.745095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884a9df-fe7a-439b-af21-2a8e57b35e05 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.747928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27d5c1-5aaf-4c6c-8229-5427d49ae63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.749063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27d5c1-5aaf-4c6c-8229-5427d49ae63b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.749545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27d5c1-5aaf-4c6c-8229-5427d49ae63b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.750015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27d5c1-5aaf-4c6c-8229-5427d49ae63b admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.751228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27d5c1-5aaf-4c6c-8229-5427d49ae63b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:44.752260 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27d5c1-5aaf-4c6c-8229-5427d49ae63b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.754041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27d5c1-5aaf-4c6c-8229-5427d49ae63b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.757533 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 229/474] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:44.763095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a9df-fe7a-439b-af21-2a8e57b35e05 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.774879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884a9df-fe7a-439b-af21-2a8e57b35e05 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.782858 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 246/475] 10.222.0.23 () {56 vars in 1159 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:44.784416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27d5c1-5aaf-4c6c-8229-5427d49ae63b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.784918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a471c-aea4-47e8-8ad5-3df860ad78c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.785938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a471c-aea4-47e8-8ad5-3df860ad78c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.786236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a471c-aea4-47e8-8ad5-3df860ad78c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.786502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a471c-aea4-47e8-8ad5-3df860ad78c3 admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/c0b9d35e26e64c959e075622321df3a4/roles/a7290d45b88b4a14ab8a17f724c7adf9` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.796805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27d5c1-5aaf-4c6c-8229-5427d49ae63b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.802403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68adf0-ae4b-4276-80d7-b3a28d31b50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.802530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a471c-aea4-47e8-8ad5-3df860ad78c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=c0b9d35e26e64c959e075622321df3a4, role_id=a7290d45b88b4a14ab8a17f724c7adf9)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.803607 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68adf0-ae4b-4276-80d7-b3a28d31b50e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.804132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68adf0-ae4b-4276-80d7-b3a28d31b50e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.804598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68adf0-ae4b-4276-80d7-b3a28d31b50e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.805157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a471c-aea4-47e8-8ad5-3df860ad78c3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.815998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68adf0-ae4b-4276-80d7-b3a28d31b50e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.818881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68adf0-ae4b-4276-80d7-b3a28d31b50e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.822717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 230/476] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:44 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/c0b9d35e26e64c959e075622321df3a4/roles/a7290d45b88b4a14ab8a17f724c7adf9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:44.822717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a471c-aea4-47e8-8ad5-3df860ad78c3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.849671 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-ed68adf0-ae4b-4276-80d7-b3a28d31b50e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:44.851350 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 247/477] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:44.852737 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad74b-e14a-4655-9db1-177252bec9c9 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.853026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad74b-e14a-4655-9db1-177252bec9c9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.853305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad74b-e14a-4655-9db1-177252bec9c9 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.860219 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 248/478] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:44 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:44.861198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad74b-e14a-4655-9db1-177252bec9c9 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.912702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a471c-aea4-47e8-8ad5-3df860ad78c3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.919505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a10b4-a382-4fe6-b570-b1c606a4f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.920533 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a10b4-a382-4fe6-b570-b1c606a4f2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.920824 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a10b4-a382-4fe6-b570-b1c606a4f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.921150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a10b4-a382-4fe6-b570-b1c606a4f2f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.930920 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad74b-e14a-4655-9db1-177252bec9c9 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.935170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a10b4-a382-4fe6-b570-b1c606a4f2f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.937095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25473c40-cd20-4fc5-978d-00004fd46024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.937364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a10b4-a382-4fe6-b570-b1c606a4f2f2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.938269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25473c40-cd20-4fc5-978d-00004fd46024 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.938769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25473c40-cd20-4fc5-978d-00004fd46024 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.939495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25473c40-cd20-4fc5-978d-00004fd46024 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.940775 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25473c40-cd20-4fc5-978d-00004fd46024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:44.941265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25473c40-cd20-4fc5-978d-00004fd46024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.943756 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25473c40-cd20-4fc5-978d-00004fd46024 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.958285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-e30a10b4-a382-4fe6-b570-b1c606a4f2f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:44.959324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 249/479] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:44.959989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 231/480] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:44.961317 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a96d4-3e0e-48ae-8be3-3a9ecd17e63b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.961760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a96d4-3e0e-48ae-8be3-3a9ecd17e63b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.962231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a96d4-3e0e-48ae-8be3-3a9ecd17e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.965773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a10b4-a382-4fe6-b570-b1c606a4f2f2 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:44.977596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a10b4-a382-4fe6-b570-b1c606a4f2f2 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:44.983087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d9e33-26b1-4191-8364-10625b55dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:44.983989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d9e33-26b1-4191-8364-10625b55dffe admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:44.984274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d9e33-26b1-4191-8364-10625b55dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:44.984552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d9e33-26b1-4191-8364-10625b55dffe admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:44.985203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8d2a96d4-3e0e-48ae-8be3-3a9ecd17e63b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:44.987011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8d2a96d4-3e0e-48ae-8be3-3a9ecd17e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:44.995340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d9e33-26b1-4191-8364-10625b55dffe admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:44.997520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 250/481] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:44.997852 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d9e33-26b1-4191-8364-10625b55dffe admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:44.998326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a96d4-3e0e-48ae-8be3-3a9ecd17e63b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.011590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a96d4-3e0e-48ae-8be3-3a9ecd17e63b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.016309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ace578-99f4-4c59-a367-f94fa9b385b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.016964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ace578-99f4-4c59-a367-f94fa9b385b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.017250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ace578-99f4-4c59-a367-f94fa9b385b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.017531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ace578-99f4-4c59-a367-f94fa9b385b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.018265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ace578-99f4-4c59-a367-f94fa9b385b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.018616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ace578-99f4-4c59-a367-f94fa9b385b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.019955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-035d9e33-26b1-4191-8364-10625b55dffe admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 01:15:45.020287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ace578-99f4-4c59-a367-f94fa9b385b3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.022071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 232/482] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:45.027922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d9e33-26b1-4191-8364-10625b55dffe admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.036649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 251/483] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:45.037662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ace578-99f4-4c59-a367-f94fa9b385b3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.040831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d9e33-26b1-4191-8364-10625b55dffe admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.046399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ac9a2-391a-4303-8a02-044664c42758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.047113 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ac9a2-391a-4303-8a02-044664c42758 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.047375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ac9a2-391a-4303-8a02-044664c42758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.047650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ac9a2-391a-4303-8a02-044664c42758 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.048368 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ace578-99f4-4c59-a367-f94fa9b385b3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.048473 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ac9a2-391a-4303-8a02-044664c42758 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.048791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ac9a2-391a-4303-8a02-044664c42758 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.050704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ac9a2-391a-4303-8a02-044664c42758 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.053611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63cd82-5efc-4c84-9fb8-9d49830b79d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.054503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63cd82-5efc-4c84-9fb8-9d49830b79d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.055501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63cd82-5efc-4c84-9fb8-9d49830b79d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.055501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63cd82-5efc-4c84-9fb8-9d49830b79d6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.071602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63cd82-5efc-4c84-9fb8-9d49830b79d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:45.078061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 233/484] 10.222.0.23 () {56 vars in 1161 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:45.079050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ac9a2-391a-4303-8a02-044664c42758 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.079786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-0a63cd82-5efc-4c84-9fb8-9d49830b79d6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:45.086299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 252/485] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:45.087922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63cd82-5efc-4c84-9fb8-9d49830b79d6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.091714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ac9a2-391a-4303-8a02-044664c42758 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.096300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff176057-bc72-4d6f-b1d7-8cebe8476b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.097245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff176057-bc72-4d6f-b1d7-8cebe8476b48 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.097625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff176057-bc72-4d6f-b1d7-8cebe8476b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.098599 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff176057-bc72-4d6f-b1d7-8cebe8476b48 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.099213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63cd82-5efc-4c84-9fb8-9d49830b79d6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.104273 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3d635-d174-4944-8cb0-d276d9990052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.105067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3d635-d174-4944-8cb0-d276d9990052 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.105347 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3d635-d174-4944-8cb0-d276d9990052 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.105622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3d635-d174-4944-8cb0-d276d9990052 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.106988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff176057-bc72-4d6f-b1d7-8cebe8476b48 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.109307 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff176057-bc72-4d6f-b1d7-8cebe8476b48 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.118122 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3d635-d174-4944-8cb0-d276d9990052 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.119997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3d635-d174-4944-8cb0-d276d9990052 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.123779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-ff176057-bc72-4d6f-b1d7-8cebe8476b48 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:45.125403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 234/486] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:45.126392 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff176057-bc72-4d6f-b1d7-8cebe8476b48 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.137509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff176057-bc72-4d6f-b1d7-8cebe8476b48 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.138970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-68b3d635-d174-4944-8cb0-d276d9990052 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:45.140182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 253/487] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:45.140957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3d635-d174-4944-8cb0-d276d9990052 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.143322 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f845b-c248-416e-84b3-1653b5725b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.145748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f845b-c248-416e-84b3-1653b5725b29 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.146209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f845b-c248-416e-84b3-1653b5725b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.149518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f845b-c248-416e-84b3-1653b5725b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.150406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f845b-c248-416e-84b3-1653b5725b29 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.150860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f845b-c248-416e-84b3-1653b5725b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.152527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f845b-c248-416e-84b3-1653b5725b29 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.156580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3d635-d174-4944-8cb0-d276d9990052 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.161395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 235/488] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:45.162323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f845b-c248-416e-84b3-1653b5725b29 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.163302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0addfef-1039-405a-9776-ed549c851a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.163954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0addfef-1039-405a-9776-ed549c851a29 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.164289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0addfef-1039-405a-9776-ed549c851a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.164566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0addfef-1039-405a-9776-ed549c851a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.165458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0addfef-1039-405a-9776-ed549c851a29 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.165769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0addfef-1039-405a-9776-ed549c851a29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.167814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0addfef-1039-405a-9776-ed549c851a29 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.173857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f845b-c248-416e-84b3-1653b5725b29 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.180242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17244b-c4b9-466b-b11b-d9d64b429975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.181158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17244b-c4b9-466b-b11b-d9d64b429975 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.181638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17244b-c4b9-466b-b11b-d9d64b429975 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.181999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 254/489] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:45.182396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17244b-c4b9-466b-b11b-d9d64b429975 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.183059 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0addfef-1039-405a-9776-ed549c851a29 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.183646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17244b-c4b9-466b-b11b-d9d64b429975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.184223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17244b-c4b9-466b-b11b-d9d64b429975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.186005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17244b-c4b9-466b-b11b-d9d64b429975 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.194194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0addfef-1039-405a-9776-ed549c851a29 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.199921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 236/490] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:45.200222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3ef87-ef44-4578-b3a8-ea3493d4b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.200910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ef87-ef44-4578-b3a8-ea3493d4b40c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.201196 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ef87-ef44-4578-b3a8-ea3493d4b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.201472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ef87-ef44-4578-b3a8-ea3493d4b40c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.201951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17244b-c4b9-466b-b11b-d9d64b429975 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.214203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17244b-c4b9-466b-b11b-d9d64b429975 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.220502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b785a-b373-451b-9027-e1f37abea974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.220671 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3ef87-ef44-4578-b3a8-ea3493d4b40c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.221781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b785a-b373-451b-9027-e1f37abea974 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.222300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b785a-b373-451b-9027-e1f37abea974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.222660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3ef87-ef44-4578-b3a8-ea3493d4b40c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.223522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b785a-b373-451b-9027-e1f37abea974 admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/1dde8359945b45bbbf5d3a27964a7f5b/roles/a7290d45b88b4a14ab8a17f724c7adf9` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.241256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b785a-b373-451b-9027-e1f37abea974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=1dde8359945b45bbbf5d3a27964a7f5b, role_id=a7290d45b88b4a14ab8a17f724c7adf9)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.243046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-a4f3ef87-ef44-4578-b3a8-ea3493d4b40c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:45.244455 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 255/491] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:45.245037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3ef87-ef44-4578-b3a8-ea3493d4b40c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.245305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b785a-b373-451b-9027-e1f37abea974 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.256360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3ef87-ef44-4578-b3a8-ea3493d4b40c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.261418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa0d7-955a-459f-a87b-281c36dca4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.262294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa0d7-955a-459f-a87b-281c36dca4aa admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.262585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa0d7-955a-459f-a87b-281c36dca4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.262888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa0d7-955a-459f-a87b-281c36dca4aa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.264709 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 237/492] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:45 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/1dde8359945b45bbbf5d3a27964a7f5b/roles/a7290d45b88b4a14ab8a17f724c7adf9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:45.266370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b785a-b373-451b-9027-e1f37abea974 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.271284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daa0d7-955a-459f-a87b-281c36dca4aa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.273470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daa0d7-955a-459f-a87b-281c36dca4aa admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.289246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-52daa0d7-955a-459f-a87b-281c36dca4aa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:45.290778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 256/493] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:45.296691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa0d7-955a-459f-a87b-281c36dca4aa admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.307946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa0d7-955a-459f-a87b-281c36dca4aa admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.339684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b785a-b373-451b-9027-e1f37abea974 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.345281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c46fa-ecef-49b8-a26c-b6a6d6639bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.346328 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c46fa-ecef-49b8-a26c-b6a6d6639bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.346916 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c46fa-ecef-49b8-a26c-b6a6d6639bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.347514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c46fa-ecef-49b8-a26c-b6a6d6639bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.349035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c46fa-ecef-49b8-a26c-b6a6d6639bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.349548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c46fa-ecef-49b8-a26c-b6a6d6639bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.351560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c46fa-ecef-49b8-a26c-b6a6d6639bd7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.368411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 238/494] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:45.373350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c46fa-ecef-49b8-a26c-b6a6d6639bd7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.385794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c46fa-ecef-49b8-a26c-b6a6d6639bd7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.391615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fd7c6-c9ce-4d98-ade0-c2cd401b2583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.393447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd7c6-c9ce-4d98-ade0-c2cd401b2583 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.393944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd7c6-c9ce-4d98-ade0-c2cd401b2583 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.394548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd7c6-c9ce-4d98-ade0-c2cd401b2583 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.404256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fd7c6-c9ce-4d98-ade0-c2cd401b2583 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.406743 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fd7c6-c9ce-4d98-ade0-c2cd401b2583 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.424977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-607fd7c6-c9ce-4d98-ade0-c2cd401b2583 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 01:15:45.427208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 239/495] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:45.431635 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c27fbf-c3b6-47e5-b0d5-95260e3a21cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.434728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fd7c6-c9ce-4d98-ade0-c2cd401b2583 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.435598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c27fbf-c3b6-47e5-b0d5-95260e3a21cc admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.436457 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c27fbf-c3b6-47e5-b0d5-95260e3a21cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.440660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c27fbf-c3b6-47e5-b0d5-95260e3a21cc admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.444481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c27fbf-c3b6-47e5-b0d5-95260e3a21cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.445034 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c27fbf-c3b6-47e5-b0d5-95260e3a21cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.450418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c27fbf-c3b6-47e5-b0d5-95260e3a21cc admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.454844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fd7c6-c9ce-4d98-ade0-c2cd401b2583 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.461087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c330047-9814-440e-b411-3dc0109fb3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.462614 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c330047-9814-440e-b411-3dc0109fb3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.463213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c330047-9814-440e-b411-3dc0109fb3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.464170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c330047-9814-440e-b411-3dc0109fb3a5 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.465563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c330047-9814-440e-b411-3dc0109fb3a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.466088 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c330047-9814-440e-b411-3dc0109fb3a5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.467096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 257/496] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:45.468546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c330047-9814-440e-b411-3dc0109fb3a5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.474321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c27fbf-c3b6-47e5-b0d5-95260e3a21cc admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.488093 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c27fbf-c3b6-47e5-b0d5-95260e3a21cc admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.492771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da14c1d-9376-4f7e-98f7-ee4bdda42132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.493758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14c1d-9376-4f7e-98f7-ee4bdda42132 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.494039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14c1d-9376-4f7e-98f7-ee4bdda42132 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.494365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14c1d-9376-4f7e-98f7-ee4bdda42132 admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/a08ace1a65c040bf97108a1660f962ee/roles/a7290d45b88b4a14ab8a17f724c7adf9` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.495894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 240/497] 10.222.0.23 () {56 vars in 1157 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:45.502915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c330047-9814-440e-b411-3dc0109fb3a5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.515068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da14c1d-9376-4f7e-98f7-ee4bdda42132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=a08ace1a65c040bf97108a1660f962ee, role_id=a7290d45b88b4a14ab8a17f724c7adf9)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.517693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c330047-9814-440e-b411-3dc0109fb3a5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.517973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da14c1d-9376-4f7e-98f7-ee4bdda42132 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.524060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e56ab-2f52-4dda-9e74-cfb7b9be5def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.524696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e56ab-2f52-4dda-9e74-cfb7b9be5def admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.524977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e56ab-2f52-4dda-9e74-cfb7b9be5def admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.525252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e56ab-2f52-4dda-9e74-cfb7b9be5def admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.533858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e56ab-2f52-4dda-9e74-cfb7b9be5def admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.535278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 258/498] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:45 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/a08ace1a65c040bf97108a1660f962ee/roles/a7290d45b88b4a14ab8a17f724c7adf9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:15:45.538736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e56ab-2f52-4dda-9e74-cfb7b9be5def admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.547166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 241/499] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:45.553324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da14c1d-9376-4f7e-98f7-ee4bdda42132 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.622661 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da14c1d-9376-4f7e-98f7-ee4bdda42132 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.627648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fa259-e11f-4ccf-8d58-7158592d7a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.628731 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fa259-e11f-4ccf-8d58-7158592d7a56 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.629259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fa259-e11f-4ccf-8d58-7158592d7a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.629718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fa259-e11f-4ccf-8d58-7158592d7a56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.641578 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fa259-e11f-4ccf-8d58-7158592d7a56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.643832 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fa259-e11f-4ccf-8d58-7158592d7a56 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.664221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-e81fa259-e11f-4ccf-8d58-7158592d7a56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:45.666123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 259/500] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:45.672158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e56ab-2f52-4dda-9e74-cfb7b9be5def admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.693350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e56ab-2f52-4dda-9e74-cfb7b9be5def admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.704784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6662-563a-4f13-9c2b-a2144b65f743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.705509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6662-563a-4f13-9c2b-a2144b65f743 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.705796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6662-563a-4f13-9c2b-a2144b65f743 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.706072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6662-563a-4f13-9c2b-a2144b65f743 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.706903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda6662-563a-4f13-9c2b-a2144b65f743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.707211 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda6662-563a-4f13-9c2b-a2144b65f743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.709389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda6662-563a-4f13-9c2b-a2144b65f743 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.730043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 242/501] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:45.736161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fa259-e11f-4ccf-8d58-7158592d7a56 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.746531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fa259-e11f-4ccf-8d58-7158592d7a56 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.751757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea555a-38c0-4296-a719-74fb3282a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.752762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea555a-38c0-4296-a719-74fb3282a5ec admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.753238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea555a-38c0-4296-a719-74fb3282a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.753685 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea555a-38c0-4296-a719-74fb3282a5ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.761390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea555a-38c0-4296-a719-74fb3282a5ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.763952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea555a-38c0-4296-a719-74fb3282a5ec admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.777857 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-81ea555a-38c0-4296-a719-74fb3282a5ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:45.781269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 260/502] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:45.787875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6662-563a-4f13-9c2b-a2144b65f743 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.799875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6662-563a-4f13-9c2b-a2144b65f743 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.805240 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13c0c1-f80f-453e-98ec-195160749e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.805892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c0c1-f80f-453e-98ec-195160749e8a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.806178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c0c1-f80f-453e-98ec-195160749e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.806455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c0c1-f80f-453e-98ec-195160749e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.807290 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13c0c1-f80f-453e-98ec-195160749e8a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.807589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13c0c1-f80f-453e-98ec-195160749e8a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.810832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13c0c1-f80f-453e-98ec-195160749e8a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.825199 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 243/503] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:45.831722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea555a-38c0-4296-a719-74fb3282a5ec admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:45.844409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea555a-38c0-4296-a719-74fb3282a5ec admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:45.849040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4324d4-5889-4104-8692-f583ae942e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:45.849684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4324d4-5889-4104-8692-f583ae942e18 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:45.849968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4324d4-5889-4104-8692-f583ae942e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:45.850245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4324d4-5889-4104-8692-f583ae942e18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:45.851112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4324d4-5889-4104-8692-f583ae942e18 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=861c258c3fbf470fac4af9966ac5f0c5) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:45.851424 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4324d4-5889-4104-8692-f583ae942e18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:45.853270 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4324d4-5889-4104-8692-f583ae942e18 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:45.859206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 261/504] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:45 2021] GET /identity/v3/role_assignments?user.id=861c258c3fbf470fac4af9966ac5f0c5&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:46.518626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863a14f-826c-4070-b2fe-25732320d8d4 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:46.519145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863a14f-826c-4070-b2fe-25732320d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:46.519229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863a14f-826c-4070-b2fe-25732320d8d4 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:46.521356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 244/505] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:46.536994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8343f4c-96aa-46f3-bf80-af876d1c6430 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:46.537450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8343f4c-96aa-46f3-bf80-af876d1c6430 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:46.537547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8343f4c-96aa-46f3-bf80-af876d1c6430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:46.557892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d8343f4c-96aa-46f3-bf80-af876d1c6430 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:46.559178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d8343f4c-96aa-46f3-bf80-af876d1c6430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:46.573287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 262/506] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:46.621923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863a14f-826c-4070-b2fe-25732320d8d4 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:46.636635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863a14f-826c-4070-b2fe-25732320d8d4 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:46.644784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f851f-79f7-4572-b0e1-97b8dcb0368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:46.645580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f851f-79f7-4572-b0e1-97b8dcb0368d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:46.645863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f851f-79f7-4572-b0e1-97b8dcb0368d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:46.646216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f851f-79f7-4572-b0e1-97b8dcb0368d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:46.659029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f851f-79f7-4572-b0e1-97b8dcb0368d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:46.666375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-198f851f-79f7-4572-b0e1-97b8dcb0368d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:46.667806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 245/507] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:46.674054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8343f4c-96aa-46f3-bf80-af876d1c6430 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:46.687766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8343f4c-96aa-46f3-bf80-af876d1c6430 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:46.695309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377aead-ca9f-4d97-9c91-ef8c4f53f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:46.695989 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377aead-ca9f-4d97-9c91-ef8c4f53f4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:46.696275 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377aead-ca9f-4d97-9c91-ef8c4f53f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:46.696555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377aead-ca9f-4d97-9c91-ef8c4f53f4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:46.697309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377aead-ca9f-4d97-9c91-ef8c4f53f4b0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:46.697614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377aead-ca9f-4d97-9c91-ef8c4f53f4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:46.699254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377aead-ca9f-4d97-9c91-ef8c4f53f4b0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:46.707944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 263/508] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:46.713932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f851f-79f7-4572-b0e1-97b8dcb0368d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:46.724508 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f851f-79f7-4572-b0e1-97b8dcb0368d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:46.735268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1876e-2636-47e1-bc34-b17cd5ad9c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:46.736064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1876e-2636-47e1-bc34-b17cd5ad9c4d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:46.736347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1876e-2636-47e1-bc34-b17cd5ad9c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:46.736625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1876e-2636-47e1-bc34-b17cd5ad9c4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:46.753454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1876e-2636-47e1-bc34-b17cd5ad9c4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:46.755628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1876e-2636-47e1-bc34-b17cd5ad9c4d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:46.775595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-70e1876e-2636-47e1-bc34-b17cd5ad9c4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:46.776951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 246/509] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:46.782745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377aead-ca9f-4d97-9c91-ef8c4f53f4b0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:46.795608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377aead-ca9f-4d97-9c91-ef8c4f53f4b0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:46.803305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd014b2-2dee-4f04-a559-860118835158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:46.803978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd014b2-2dee-4f04-a559-860118835158 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:46.804266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd014b2-2dee-4f04-a559-860118835158 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:46.804549 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd014b2-2dee-4f04-a559-860118835158 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:46.805287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd014b2-2dee-4f04-a559-860118835158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:46.805601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd014b2-2dee-4f04-a559-860118835158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:46.807279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd014b2-2dee-4f04-a559-860118835158 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:46.820840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 264/510] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:46.826991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1876e-2636-47e1-bc34-b17cd5ad9c4d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:46.839577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1876e-2636-47e1-bc34-b17cd5ad9c4d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:46.847300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabecbb-7c10-4356-bbfe-b71d75c1f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:46.848690 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabecbb-7c10-4356-bbfe-b71d75c1f833 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:46.848973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabecbb-7c10-4356-bbfe-b71d75c1f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:46.849250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabecbb-7c10-4356-bbfe-b71d75c1f833 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:46.857503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabecbb-7c10-4356-bbfe-b71d75c1f833 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:46.859587 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabecbb-7c10-4356-bbfe-b71d75c1f833 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:46.876357 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-6aabecbb-7c10-4356-bbfe-b71d75c1f833 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 01:15:46.877765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 247/511] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 25 01:15:46 2021] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:46.883690 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd014b2-2dee-4f04-a559-860118835158 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:46.899948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd014b2-2dee-4f04-a559-860118835158 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:46.907801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fa050-b073-4b7c-90d5-8a47c41488de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:46.908470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fa050-b073-4b7c-90d5-8a47c41488de admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:46.908754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fa050-b073-4b7c-90d5-8a47c41488de admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:46.909030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fa050-b073-4b7c-90d5-8a47c41488de admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:46.909873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fa050-b073-4b7c-90d5-8a47c41488de admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:46.910181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fa050-b073-4b7c-90d5-8a47c41488de admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:46.912602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fa050-b073-4b7c-90d5-8a47c41488de admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:46.938096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 265/512] 10.222.0.23 () {56 vars in 1155 bytes} [Wed Aug 25 01:15:46 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:46.943950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabecbb-7c10-4356-bbfe-b71d75c1f833 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:46.960222 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabecbb-7c10-4356-bbfe-b71d75c1f833 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:46.968615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59033a1b-bf5a-4207-ab0f-0d4ceaedb4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:46.969254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59033a1b-bf5a-4207-ab0f-0d4ceaedb4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:46.969537 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59033a1b-bf5a-4207-ab0f-0d4ceaedb4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:46.969809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59033a1b-bf5a-4207-ab0f-0d4ceaedb4d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:46.982121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59033a1b-bf5a-4207-ab0f-0d4ceaedb4d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:46.983895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59033a1b-bf5a-4207-ab0f-0d4ceaedb4d7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:46.995966 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 248/513] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:47.001808 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fa050-b073-4b7c-90d5-8a47c41488de admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.015880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fa050-b073-4b7c-90d5-8a47c41488de admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.023821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b0c5b-b5f7-4200-ac2b-2c534cca2ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.024614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b0c5b-b5f7-4200-ac2b-2c534cca2ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.024898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b0c5b-b5f7-4200-ac2b-2c534cca2ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.025174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b0c5b-b5f7-4200-ac2b-2c534cca2ac7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.038969 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b0c5b-b5f7-4200-ac2b-2c534cca2ac7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.040744 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b0c5b-b5f7-4200-ac2b-2c534cca2ac7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.061673 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-738b0c5b-b5f7-4200-ac2b-2c534cca2ac7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:47.063267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 266/514] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:47.069046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59033a1b-bf5a-4207-ab0f-0d4ceaedb4d7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.078014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59033a1b-bf5a-4207-ab0f-0d4ceaedb4d7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.086754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814eb26-9b46-4d9f-b046-a84f0db25782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.087402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814eb26-9b46-4d9f-b046-a84f0db25782 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.087688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814eb26-9b46-4d9f-b046-a84f0db25782 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.087967 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814eb26-9b46-4d9f-b046-a84f0db25782 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.088691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814eb26-9b46-4d9f-b046-a84f0db25782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:47.088999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814eb26-9b46-4d9f-b046-a84f0db25782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.090588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814eb26-9b46-4d9f-b046-a84f0db25782 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.106246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 249/515] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:47.111825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b0c5b-b5f7-4200-ac2b-2c534cca2ac7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.128417 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b0c5b-b5f7-4200-ac2b-2c534cca2ac7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.136578 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5de37d-21a4-426c-bfe0-c6fcf1505f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.137367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5de37d-21a4-426c-bfe0-c6fcf1505f74 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.137647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5de37d-21a4-426c-bfe0-c6fcf1505f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.137919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5de37d-21a4-426c-bfe0-c6fcf1505f74 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.147751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5de37d-21a4-426c-bfe0-c6fcf1505f74 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.149716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5de37d-21a4-426c-bfe0-c6fcf1505f74 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.163823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-ab5de37d-21a4-426c-bfe0-c6fcf1505f74 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:47.165230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 267/516] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:47.171300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814eb26-9b46-4d9f-b046-a84f0db25782 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.183584 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814eb26-9b46-4d9f-b046-a84f0db25782 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.191303 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb34910-b69a-4643-a153-30f68684a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.192049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb34910-b69a-4643-a153-30f68684a593 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.192339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb34910-b69a-4643-a153-30f68684a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.192621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb34910-b69a-4643-a153-30f68684a593 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.193412 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb34910-b69a-4643-a153-30f68684a593 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:47.193720 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb34910-b69a-4643-a153-30f68684a593 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.195580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb34910-b69a-4643-a153-30f68684a593 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.208145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 250/517] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:47.214496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5de37d-21a4-426c-bfe0-c6fcf1505f74 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.227450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5de37d-21a4-426c-bfe0-c6fcf1505f74 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.235846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642b002-3c1b-4601-9177-21a457f77979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.236506 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642b002-3c1b-4601-9177-21a457f77979 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.236791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642b002-3c1b-4601-9177-21a457f77979 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.237068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642b002-3c1b-4601-9177-21a457f77979 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.237897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642b002-3c1b-4601-9177-21a457f77979 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=d061cf5060334e79ab4f22518d37116f) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:47.238202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642b002-3c1b-4601-9177-21a457f77979 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.240104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642b002-3c1b-4601-9177-21a457f77979 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.247243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 268/518] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/role_assignments?user.id=d061cf5060334e79ab4f22518d37116f&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:47.539380 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bba130-30b9-4797-b21e-e3210ca00727 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.539922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bba130-30b9-4797-b21e-e3210ca00727 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.539922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bba130-30b9-4797-b21e-e3210ca00727 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.541682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 251/519] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:47.547747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025a435-447f-41c9-9ebe-5eb5a749709a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.548230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025a435-447f-41c9-9ebe-5eb5a749709a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.548392 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025a435-447f-41c9-9ebe-5eb5a749709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.566128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6025a435-447f-41c9-9ebe-5eb5a749709a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:47.567888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6025a435-447f-41c9-9ebe-5eb5a749709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:47.575777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 269/520] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:47.599983 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bba130-30b9-4797-b21e-e3210ca00727 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.612217 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bba130-30b9-4797-b21e-e3210ca00727 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.616575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae5922-233f-41cd-9ed2-80d905b04e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.617354 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae5922-233f-41cd-9ed2-80d905b04e47 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.617637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae5922-233f-41cd-9ed2-80d905b04e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.617912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae5922-233f-41cd-9ed2-80d905b04e47 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.628483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae5922-233f-41cd-9ed2-80d905b04e47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:47.635867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-96ae5922-233f-41cd-9ed2-80d905b04e47 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:47.637329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 252/521] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:47.644040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025a435-447f-41c9-9ebe-5eb5a749709a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.653828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025a435-447f-41c9-9ebe-5eb5a749709a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.658324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79cf46-5999-4bc3-a99e-12b128b232c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.659039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79cf46-5999-4bc3-a99e-12b128b232c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.659318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79cf46-5999-4bc3-a99e-12b128b232c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.659597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79cf46-5999-4bc3-a99e-12b128b232c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.660383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79cf46-5999-4bc3-a99e-12b128b232c2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:47.660692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79cf46-5999-4bc3-a99e-12b128b232c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.662302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79cf46-5999-4bc3-a99e-12b128b232c2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.671344 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 270/522] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:47.677330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae5922-233f-41cd-9ed2-80d905b04e47 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.688307 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae5922-233f-41cd-9ed2-80d905b04e47 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.693325 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03c73e-cf5f-42c6-8c51-183563264b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.694101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03c73e-cf5f-42c6-8c51-183563264b0f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.694378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03c73e-cf5f-42c6-8c51-183563264b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.694652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03c73e-cf5f-42c6-8c51-183563264b0f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.705071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03c73e-cf5f-42c6-8c51-183563264b0f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.706946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03c73e-cf5f-42c6-8c51-183563264b0f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.724952 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-5e03c73e-cf5f-42c6-8c51-183563264b0f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:47.726420 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 253/523] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:47.732576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79cf46-5999-4bc3-a99e-12b128b232c2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.743206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79cf46-5999-4bc3-a99e-12b128b232c2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.748658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fde4ff-c7f5-4f8f-9a35-dee1ad215bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.749315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fde4ff-c7f5-4f8f-9a35-dee1ad215bfb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.749656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fde4ff-c7f5-4f8f-9a35-dee1ad215bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.749937 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fde4ff-c7f5-4f8f-9a35-dee1ad215bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.750659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fde4ff-c7f5-4f8f-9a35-dee1ad215bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:47.751516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fde4ff-c7f5-4f8f-9a35-dee1ad215bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.752746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fde4ff-c7f5-4f8f-9a35-dee1ad215bfb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.766408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 271/524] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:47.772424 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03c73e-cf5f-42c6-8c51-183563264b0f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.783023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03c73e-cf5f-42c6-8c51-183563264b0f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.787622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d5faf-1d48-486a-830b-21b3ba003b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.788504 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d5faf-1d48-486a-830b-21b3ba003b8a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.788786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d5faf-1d48-486a-830b-21b3ba003b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.789060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d5faf-1d48-486a-830b-21b3ba003b8a admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.796831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d5faf-1d48-486a-830b-21b3ba003b8a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.798861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d5faf-1d48-486a-830b-21b3ba003b8a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.813688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-4d4d5faf-1d48-486a-830b-21b3ba003b8a admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 01:15:47.815227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 254/525] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/users/glance => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:47.822017 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fde4ff-c7f5-4f8f-9a35-dee1ad215bfb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.832120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fde4ff-c7f5-4f8f-9a35-dee1ad215bfb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.837939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cc38a-da7f-4062-acaa-447925f6f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.838694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cc38a-da7f-4062-acaa-447925f6f578 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.838979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cc38a-da7f-4062-acaa-447925f6f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.839255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cc38a-da7f-4062-acaa-447925f6f578 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.840151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cc38a-da7f-4062-acaa-447925f6f578 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:47.840466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cc38a-da7f-4062-acaa-447925f6f578 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.842411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cc38a-da7f-4062-acaa-447925f6f578 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.861440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 272/526] 10.222.0.23 () {56 vars in 1159 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:47.868105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d5faf-1d48-486a-830b-21b3ba003b8a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.879696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d5faf-1d48-486a-830b-21b3ba003b8a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.884573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ce64-7ad2-4829-b3dc-6b7ecbf07523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.885239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ce64-7ad2-4829-b3dc-6b7ecbf07523 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.885576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ce64-7ad2-4829-b3dc-6b7ecbf07523 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.885858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ce64-7ad2-4829-b3dc-6b7ecbf07523 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.895563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4ce64-7ad2-4829-b3dc-6b7ecbf07523 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.897485 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4ce64-7ad2-4829-b3dc-6b7ecbf07523 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.908659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 255/527] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:47.915190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cc38a-da7f-4062-acaa-447925f6f578 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.925530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cc38a-da7f-4062-acaa-447925f6f578 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.930912 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aab0bb-d15e-4a61-a10d-0bacd35b3f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.931766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab0bb-d15e-4a61-a10d-0bacd35b3f2f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.932065 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab0bb-d15e-4a61-a10d-0bacd35b3f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.932378 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab0bb-d15e-4a61-a10d-0bacd35b3f2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.944173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aab0bb-d15e-4a61-a10d-0bacd35b3f2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.946022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aab0bb-d15e-4a61-a10d-0bacd35b3f2f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:47.963901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-f6aab0bb-d15e-4a61-a10d-0bacd35b3f2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:47.965349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 273/528] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:47.971495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ce64-7ad2-4829-b3dc-6b7ecbf07523 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:47.979815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a54505-2d65-4c96-ab05-adabcc1a8678 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.980101 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a54505-2d65-4c96-ab05-adabcc1a8678 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.980382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a54505-2d65-4c96-ab05-adabcc1a8678 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.981141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ce64-7ad2-4829-b3dc-6b7ecbf07523 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:47.982161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 274/529] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:47.986012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88587d-ad6c-4c19-ad99-008998550343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:47.986828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88587d-ad6c-4c19-ad99-008998550343 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.987016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88587d-ad6c-4c19-ad99-008998550343 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.987341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88587d-ad6c-4c19-ad99-008998550343 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.988049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318903-5c15-4ceb-b3df-f484e83aca46 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:47.988231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88587d-ad6c-4c19-ad99-008998550343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:47.988383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318903-5c15-4ceb-b3df-f484e83aca46 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:47.989066 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88587d-ad6c-4c19-ad99-008998550343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:47.989210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318903-5c15-4ceb-b3df-f484e83aca46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:47.990520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88587d-ad6c-4c19-ad99-008998550343 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.005639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 256/530] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.011416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88587d-ad6c-4c19-ad99-008998550343 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.013505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-ca318903-5c15-4ceb-b3df-f484e83aca46 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:48.014749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ca318903-5c15-4ceb-b3df-f484e83aca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:48.024945 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88587d-ad6c-4c19-ad99-008998550343 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.031175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 275/531] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 25 01:15:48.042179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354e7fe-2325-44c4-a74a-daf42ff51aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.043108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e7fe-2325-44c4-a74a-daf42ff51aab admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.043448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e7fe-2325-44c4-a74a-daf42ff51aab admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.043728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e7fe-2325-44c4-a74a-daf42ff51aab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.056633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354e7fe-2325-44c4-a74a-daf42ff51aab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.058607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354e7fe-2325-44c4-a74a-daf42ff51aab admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.082405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-6354e7fe-2325-44c4-a74a-daf42ff51aab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:48.083945 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 257/532] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:48.087034 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca318903-5c15-4ceb-b3df-f484e83aca46 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.094320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354e7fe-2325-44c4-a74a-daf42ff51aab admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.097173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca318903-5c15-4ceb-b3df-f484e83aca46 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.107224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a730c0c-ec20-4575-a91c-1ac5a708e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.108024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730c0c-ec20-4575-a91c-1ac5a708e784 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.108306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730c0c-ec20-4575-a91c-1ac5a708e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.108584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a730c0c-ec20-4575-a91c-1ac5a708e784 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.113567 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354e7fe-2325-44c4-a74a-daf42ff51aab admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.125830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a730c0c-ec20-4575-a91c-1ac5a708e784 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:48.127381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9242c7-d143-4655-b028-2b8eb43b03b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.128049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9242c7-d143-4655-b028-2b8eb43b03b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.128335 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9242c7-d143-4655-b028-2b8eb43b03b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.128612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9242c7-d143-4655-b028-2b8eb43b03b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.129448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9242c7-d143-4655-b028-2b8eb43b03b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.129758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9242c7-d143-4655-b028-2b8eb43b03b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.131641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9242c7-d143-4655-b028-2b8eb43b03b7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.132868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-1a730c0c-ec20-4575-a91c-1ac5a708e784 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:48.134346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 276/533] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:48.140970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a730c0c-ec20-4575-a91c-1ac5a708e784 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.146417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 258/534] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.152890 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9242c7-d143-4655-b028-2b8eb43b03b7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.154290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a730c0c-ec20-4575-a91c-1ac5a708e784 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.159259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270c067-d78f-4b74-ac79-77f236042511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.160033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270c067-d78f-4b74-ac79-77f236042511 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.160974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270c067-d78f-4b74-ac79-77f236042511 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.161708 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270c067-d78f-4b74-ac79-77f236042511 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.162241 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270c067-d78f-4b74-ac79-77f236042511 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.162655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270c067-d78f-4b74-ac79-77f236042511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.164557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270c067-d78f-4b74-ac79-77f236042511 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.170699 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9242c7-d143-4655-b028-2b8eb43b03b7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.180144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952759-cbb9-4b51-9123-cdc398d79fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.180985 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952759-cbb9-4b51-9123-cdc398d79fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.181367 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952759-cbb9-4b51-9123-cdc398d79fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.182288 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952759-cbb9-4b51-9123-cdc398d79fa0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.184063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c952759-cbb9-4b51-9123-cdc398d79fa0 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=c0b9d35e26e64c959e075622321df3a4) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.185678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c952759-cbb9-4b51-9123-cdc398d79fa0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.187706 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c952759-cbb9-4b51-9123-cdc398d79fa0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.189178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 277/535] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.200043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 259/536] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/role_assignments?user.id=c0b9d35e26e64c959e075622321df3a4&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.202301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270c067-d78f-4b74-ac79-77f236042511 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.213660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270c067-d78f-4b74-ac79-77f236042511 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.218600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c3f7b-44ac-42c8-b3b5-382b9e8bbcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.219585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c3f7b-44ac-42c8-b3b5-382b9e8bbcab admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.220058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c3f7b-44ac-42c8-b3b5-382b9e8bbcab admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.220334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c3f7b-44ac-42c8-b3b5-382b9e8bbcab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.232609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c3f7b-44ac-42c8-b3b5-382b9e8bbcab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.234568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c3f7b-44ac-42c8-b3b5-382b9e8bbcab admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.252789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-e77c3f7b-44ac-42c8-b3b5-382b9e8bbcab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:48.254936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 278/537] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:48.261206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952759-cbb9-4b51-9123-cdc398d79fa0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.272423 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952759-cbb9-4b51-9123-cdc398d79fa0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.281184 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59183178-aae2-4d5d-af74-d119af2079ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.281837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183178-aae2-4d5d-af74-d119af2079ba admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.282127 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183178-aae2-4d5d-af74-d119af2079ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.282407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183178-aae2-4d5d-af74-d119af2079ba admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.283239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59183178-aae2-4d5d-af74-d119af2079ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.283547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59183178-aae2-4d5d-af74-d119af2079ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.285405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59183178-aae2-4d5d-af74-d119af2079ba admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.300840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 260/538] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.307335 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c3f7b-44ac-42c8-b3b5-382b9e8bbcab admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.320840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c3f7b-44ac-42c8-b3b5-382b9e8bbcab admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.326482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d9cbc-cd29-4e0f-b2c3-8efc81a6cc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.327395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d9cbc-cd29-4e0f-b2c3-8efc81a6cc76 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.327681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d9cbc-cd29-4e0f-b2c3-8efc81a6cc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.327960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d9cbc-cd29-4e0f-b2c3-8efc81a6cc76 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.340446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d9cbc-cd29-4e0f-b2c3-8efc81a6cc76 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.342830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d9cbc-cd29-4e0f-b2c3-8efc81a6cc76 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.362771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-bb9d9cbc-cd29-4e0f-b2c3-8efc81a6cc76 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 01:15:48.364161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 279/539] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/users/cinder => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:48.370773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59183178-aae2-4d5d-af74-d119af2079ba admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.381939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59183178-aae2-4d5d-af74-d119af2079ba admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.388147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8220b-a027-4c37-a774-9bf855a6f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.389119 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8220b-a027-4c37-a774-9bf855a6f65f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.389402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8220b-a027-4c37-a774-9bf855a6f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.389673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8220b-a027-4c37-a774-9bf855a6f65f admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.390615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8220b-a027-4c37-a774-9bf855a6f65f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.390995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8220b-a027-4c37-a774-9bf855a6f65f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.392959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8220b-a027-4c37-a774-9bf855a6f65f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.412481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 261/540] 10.222.0.23 () {56 vars in 1159 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:48.415108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e5083-8af1-49da-ac46-3a5ac43207bc None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.415496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e5083-8af1-49da-ac46-3a5ac43207bc None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.415872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e5083-8af1-49da-ac46-3a5ac43207bc None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.418209 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 280/541] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:48.419131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8220b-a027-4c37-a774-9bf855a6f65f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.423633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aadc1-17fe-4a08-bcf8-8e7d0fe01ccf None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.423921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aadc1-17fe-4a08-bcf8-8e7d0fe01ccf None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.424198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aadc1-17fe-4a08-bcf8-8e7d0fe01ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.447560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8220b-a027-4c37-a774-9bf855a6f65f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.448676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b90aadc1-17fe-4a08-bcf8-8e7d0fe01ccf None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:48.449816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b90aadc1-17fe-4a08-bcf8-8e7d0fe01ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:48.452552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44093b-415c-4d36-a90f-45198af79042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.453471 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44093b-415c-4d36-a90f-45198af79042 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.454078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44093b-415c-4d36-a90f-45198af79042 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.454656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44093b-415c-4d36-a90f-45198af79042 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.458589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 281/542] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:48.460177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d46d-2fa5-4310-b328-12ec59ab025f None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.460519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d46d-2fa5-4310-b328-12ec59ab025f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.460897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d46d-2fa5-4310-b328-12ec59ab025f None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.466950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 282/543] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:48.469865 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed565ba-64c4-43c6-9467-6cf98738d6ae None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.470247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed565ba-64c4-43c6-9467-6cf98738d6ae None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.470798 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed565ba-64c4-43c6-9467-6cf98738d6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.471660 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44093b-415c-4d36-a90f-45198af79042 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.474698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44093b-415c-4d36-a90f-45198af79042 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.485425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 262/544] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:48.492228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44093b-415c-4d36-a90f-45198af79042 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.501442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44093b-415c-4d36-a90f-45198af79042 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.509449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-bed565ba-64c4-43c6-9467-6cf98738d6ae None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:48.509860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07417a2-c747-43fc-98db-df4d8dfe5a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.510973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07417a2-c747-43fc-98db-df4d8dfe5a98 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.511361 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-bed565ba-64c4-43c6-9467-6cf98738d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:48.511496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07417a2-c747-43fc-98db-df4d8dfe5a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.511882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07417a2-c747-43fc-98db-df4d8dfe5a98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.523707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 283/545] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:48.523707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed565ba-64c4-43c6-9467-6cf98738d6ae None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.525050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07417a2-c747-43fc-98db-df4d8dfe5a98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.526602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07417a2-c747-43fc-98db-df4d8dfe5a98 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.536562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed565ba-64c4-43c6-9467-6cf98738d6ae None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.541283 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c33ee-53cc-4311-b3c5-938df39fe573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.542463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c33ee-53cc-4311-b3c5-938df39fe573 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.542573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c33ee-53cc-4311-b3c5-938df39fe573 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.542913 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c33ee-53cc-4311-b3c5-938df39fe573 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.552676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-e07417a2-c747-43fc-98db-df4d8dfe5a98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:48.554708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 263/546] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:48.554941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c33ee-53cc-4311-b3c5-938df39fe573 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:48.556046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07417a2-c747-43fc-98db-df4d8dfe5a98 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.562220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-7b4c33ee-53cc-4311-b3c5-938df39fe573 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:48.563833 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 284/547] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:48.564282 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c33ee-53cc-4311-b3c5-938df39fe573 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.573073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07417a2-c747-43fc-98db-df4d8dfe5a98 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.576779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c33ee-53cc-4311-b3c5-938df39fe573 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.579572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc92454-7d1d-49f7-b828-bb96d086fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.580542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc92454-7d1d-49f7-b828-bb96d086fd57 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.580825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc92454-7d1d-49f7-b828-bb96d086fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.581098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc92454-7d1d-49f7-b828-bb96d086fd57 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.581325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b39d8-eab2-4328-a41c-40bb93f9df0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.581957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b39d8-eab2-4328-a41c-40bb93f9df0a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.582267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b39d8-eab2-4328-a41c-40bb93f9df0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.582543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b39d8-eab2-4328-a41c-40bb93f9df0a admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.583321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b39d8-eab2-4328-a41c-40bb93f9df0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.583611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b39d8-eab2-4328-a41c-40bb93f9df0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.585204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b39d8-eab2-4328-a41c-40bb93f9df0a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.592530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc92454-7d1d-49f7-b828-bb96d086fd57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:48.599108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 285/548] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.599912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-ddc92454-7d1d-49f7-b828-bb96d086fd57 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:48.600040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b39d8-eab2-4328-a41c-40bb93f9df0a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.601570 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 264/549] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:48.605096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc92454-7d1d-49f7-b828-bb96d086fd57 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.611908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b39d8-eab2-4328-a41c-40bb93f9df0a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.617774 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7bc53-f4a4-4e50-8c05-7e0c3bca365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.617774 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7bc53-f4a4-4e50-8c05-7e0c3bca365c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.617774 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7bc53-f4a4-4e50-8c05-7e0c3bca365c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.618058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7bc53-f4a4-4e50-8c05-7e0c3bca365c admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.618263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc92454-7d1d-49f7-b828-bb96d086fd57 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.619259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7bc53-f4a4-4e50-8c05-7e0c3bca365c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.619361 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7bc53-f4a4-4e50-8c05-7e0c3bca365c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.620918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7bc53-f4a4-4e50-8c05-7e0c3bca365c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.626028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43673a-dfca-4ce6-8f1e-36b91824ae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.627151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43673a-dfca-4ce6-8f1e-36b91824ae04 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.627151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43673a-dfca-4ce6-8f1e-36b91824ae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.627438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43673a-dfca-4ce6-8f1e-36b91824ae04 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.630548 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 286/550] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.631482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7bc53-f4a4-4e50-8c05-7e0c3bca365c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.641762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7bc53-f4a4-4e50-8c05-7e0c3bca365c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.641895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43673a-dfca-4ce6-8f1e-36b91824ae04 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.643944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43673a-dfca-4ce6-8f1e-36b91824ae04 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.646423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8b48b-118b-43e6-a790-5c8cdb651916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.647097 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b48b-118b-43e6-a790-5c8cdb651916 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.647379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b48b-118b-43e6-a790-5c8cdb651916 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.647654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b48b-118b-43e6-a790-5c8cdb651916 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.648385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8b48b-118b-43e6-a790-5c8cdb651916 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.648687 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8b48b-118b-43e6-a790-5c8cdb651916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.650251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8b48b-118b-43e6-a790-5c8cdb651916 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.658381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-cc43673a-dfca-4ce6-8f1e-36b91824ae04 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:48.659433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 287/551] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.659813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 265/552] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:48.665160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8b48b-118b-43e6-a790-5c8cdb651916 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.665723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43673a-dfca-4ce6-8f1e-36b91824ae04 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.675261 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8b48b-118b-43e6-a790-5c8cdb651916 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.677561 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43673a-dfca-4ce6-8f1e-36b91824ae04 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.680334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd2b76-e9dd-4546-b8cd-fa30fd3b0c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.681118 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd2b76-e9dd-4546-b8cd-fa30fd3b0c24 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.681403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd2b76-e9dd-4546-b8cd-fa30fd3b0c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.681678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd2b76-e9dd-4546-b8cd-fa30fd3b0c24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.683491 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ff8f4-ff7d-4bb0-9c92-613edcea9b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.684068 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ff8f4-ff7d-4bb0-9c92-613edcea9b24 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.684806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ff8f4-ff7d-4bb0-9c92-613edcea9b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.684806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ff8f4-ff7d-4bb0-9c92-613edcea9b24 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.685591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ff8f4-ff7d-4bb0-9c92-613edcea9b24 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.685961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ff8f4-ff7d-4bb0-9c92-613edcea9b24 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.687985 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ff8f4-ff7d-4bb0-9c92-613edcea9b24 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.697121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd2b76-e9dd-4546-b8cd-fa30fd3b0c24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.699044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd2b76-e9dd-4546-b8cd-fa30fd3b0c24 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.701878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 266/553] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:48.703206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ff8f4-ff7d-4bb0-9c92-613edcea9b24 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.712767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ff8f4-ff7d-4bb0-9c92-613edcea9b24 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.717228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf1fee-5df3-46ff-9482-7dadbc0990ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.718063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1fee-5df3-46ff-9482-7dadbc0990ef admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.718408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1fee-5df3-46ff-9482-7dadbc0990ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.718804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf1fee-5df3-46ff-9482-7dadbc0990ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.723179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-91fd2b76-e9dd-4546-b8cd-fa30fd3b0c24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:48.724728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 288/554] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:48.725584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd2b76-e9dd-4546-b8cd-fa30fd3b0c24 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.730275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf1fee-5df3-46ff-9482-7dadbc0990ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.732230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf1fee-5df3-46ff-9482-7dadbc0990ef admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.735443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd2b76-e9dd-4546-b8cd-fa30fd3b0c24 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.740464 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3932943-f788-4636-b5da-b3901c48c2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.741176 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3932943-f788-4636-b5da-b3901c48c2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.741530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3932943-f788-4636-b5da-b3901c48c2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.741877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3932943-f788-4636-b5da-b3901c48c2f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.742817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3932943-f788-4636-b5da-b3901c48c2f5 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=1dde8359945b45bbbf5d3a27964a7f5b) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.743243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3932943-f788-4636-b5da-b3901c48c2f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.745219 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3932943-f788-4636-b5da-b3901c48c2f5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.751261 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-9dcf1fee-5df3-46ff-9482-7dadbc0990ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:48.755743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 289/556] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/role_assignments?user.id=1dde8359945b45bbbf5d3a27964a7f5b&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.755961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 267/556] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:48.757015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3932943-f788-4636-b5da-b3901c48c2f5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.759666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf1fee-5df3-46ff-9482-7dadbc0990ef admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.769086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3932943-f788-4636-b5da-b3901c48c2f5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.769738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf1fee-5df3-46ff-9482-7dadbc0990ef admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.774256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc31ca-ba2e-4774-8367-f5efc6c5b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.774541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac592-e539-4b4f-b5ba-58de9b357fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.775252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac592-e539-4b4f-b5ba-58de9b357fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.775539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac592-e539-4b4f-b5ba-58de9b357fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.775649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc31ca-ba2e-4774-8367-f5efc6c5b8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.775821 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac592-e539-4b4f-b5ba-58de9b357fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.776213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc31ca-ba2e-4774-8367-f5efc6c5b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.776558 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ac592-e539-4b4f-b5ba-58de9b357fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.776805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc31ca-ba2e-4774-8367-f5efc6c5b8b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.776909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ac592-e539-4b4f-b5ba-58de9b357fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.777776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc31ca-ba2e-4774-8367-f5efc6c5b8b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.778309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc31ca-ba2e-4774-8367-f5efc6c5b8b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.778462 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ac592-e539-4b4f-b5ba-58de9b357fa0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.780510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc31ca-ba2e-4774-8367-f5efc6c5b8b4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.791070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 268/557] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:48.796573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 290/558] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.802055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac592-e539-4b4f-b5ba-58de9b357fa0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.803396 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc31ca-ba2e-4774-8367-f5efc6c5b8b4 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.807896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac592-e539-4b4f-b5ba-58de9b357fa0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.813617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667f32-2208-4f8e-9f3a-7bd24f5b8f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.814428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667f32-2208-4f8e-9f3a-7bd24f5b8f4f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.814745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667f32-2208-4f8e-9f3a-7bd24f5b8f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.815030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667f32-2208-4f8e-9f3a-7bd24f5b8f4f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.815814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc31ca-ba2e-4774-8367-f5efc6c5b8b4 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.822300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ba932-1d70-401b-af8f-688d3c2dbd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.823634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ba932-1d70-401b-af8f-688d3c2dbd93 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.824168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ba932-1d70-401b-af8f-688d3c2dbd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.824612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3667f32-2208-4f8e-9f3a-7bd24f5b8f4f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.824844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ba932-1d70-401b-af8f-688d3c2dbd93 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.826903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3667f32-2208-4f8e-9f3a-7bd24f5b8f4f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.834647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ba932-1d70-401b-af8f-688d3c2dbd93 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.837083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ba932-1d70-401b-af8f-688d3c2dbd93 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.843449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-e3667f32-2208-4f8e-9f3a-7bd24f5b8f4f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 01:15:48.850738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 269/559] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/users/neutron => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:48.852173 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667f32-2208-4f8e-9f3a-7bd24f5b8f4f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.853561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-3c6ba932-1d70-401b-af8f-688d3c2dbd93 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 01:15:48.855249 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 291/560] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:48.865958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ba932-1d70-401b-af8f-688d3c2dbd93 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.868620 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667f32-2208-4f8e-9f3a-7bd24f5b8f4f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.878717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445c21b-5e18-4a4e-8eb3-f959a9371a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.878717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445c21b-5e18-4a4e-8eb3-f959a9371a57 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.878717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445c21b-5e18-4a4e-8eb3-f959a9371a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.878717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445c21b-5e18-4a4e-8eb3-f959a9371a57 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.879235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445c21b-5e18-4a4e-8eb3-f959a9371a57 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.879235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445c21b-5e18-4a4e-8eb3-f959a9371a57 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.879235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445c21b-5e18-4a4e-8eb3-f959a9371a57 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.886170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ba932-1d70-401b-af8f-688d3c2dbd93 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.907543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce51c8-ef6f-4af7-924d-501083a13ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.908332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce51c8-ef6f-4af7-924d-501083a13ffa admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.908744 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce51c8-ef6f-4af7-924d-501083a13ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.909093 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce51c8-ef6f-4af7-924d-501083a13ffa admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.910023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce51c8-ef6f-4af7-924d-501083a13ffa admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:48.911191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce51c8-ef6f-4af7-924d-501083a13ffa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.913449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce51c8-ef6f-4af7-924d-501083a13ffa admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.917500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 270/561] 10.222.0.23 () {56 vars in 1161 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:48.940336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445c21b-5e18-4a4e-8eb3-f959a9371a57 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.952723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445c21b-5e18-4a4e-8eb3-f959a9371a57 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.956057 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 292/562] 10.222.0.23 () {56 vars in 1157 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:48.963112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce51c8-ef6f-4af7-924d-501083a13ffa admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:48.968304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398e4a-6d35-4711-b057-3e661de3767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.970143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398e4a-6d35-4711-b057-3e661de3767d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.971295 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398e4a-6d35-4711-b057-3e661de3767d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.971688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398e4a-6d35-4711-b057-3e661de3767d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.983804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08398e4a-6d35-4711-b057-3e661de3767d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:48.985861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08398e4a-6d35-4711-b057-3e661de3767d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:48.986337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce51c8-ef6f-4af7-924d-501083a13ffa admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:48.991968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcda20-e4b5-4881-95a9-a57361f07b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:48.992879 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcda20-e4b5-4881-95a9-a57361f07b54 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:48.993287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcda20-e4b5-4881-95a9-a57361f07b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:48.993628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcda20-e4b5-4881-95a9-a57361f07b54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:48.997839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 271/563] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:15:49.005641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398e4a-6d35-4711-b057-3e661de3767d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:49.007096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcda20-e4b5-4881-95a9-a57361f07b54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:49.009101 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcda20-e4b5-4881-95a9-a57361f07b54 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:49.016674 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398e4a-6d35-4711-b057-3e661de3767d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:49.022472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f091ce-700a-444f-a434-e23e172927d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:49.023458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f091ce-700a-444f-a434-e23e172927d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:49.023840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f091ce-700a-444f-a434-e23e172927d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:49.024224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f091ce-700a-444f-a434-e23e172927d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:49.029453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-36bcda20-e4b5-4881-95a9-a57361f07b54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:49.031001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 293/564] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:49.035079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f091ce-700a-444f-a434-e23e172927d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:49.037612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f091ce-700a-444f-a434-e23e172927d1 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:49.039857 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcda20-e4b5-4881-95a9-a57361f07b54 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:49.054367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcda20-e4b5-4881-95a9-a57361f07b54 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:49.057853 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-d2f091ce-700a-444f-a434-e23e172927d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:49.059756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 272/565] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:49.063367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23d7d-1c24-4227-9bc5-45a9bfd1ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:49.064107 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23d7d-1c24-4227-9bc5-45a9bfd1ceb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:49.064458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23d7d-1c24-4227-9bc5-45a9bfd1ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:49.064799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23d7d-1c24-4227-9bc5-45a9bfd1ceb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:49.065610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b23d7d-1c24-4227-9bc5-45a9bfd1ceb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:49.065983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b23d7d-1c24-4227-9bc5-45a9bfd1ceb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:49.067771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b23d7d-1c24-4227-9bc5-45a9bfd1ceb9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:49.071854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f091ce-700a-444f-a434-e23e172927d1 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:49.083796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 294/566] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:49.084836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f091ce-700a-444f-a434-e23e172927d1 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:49.090233 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23d7d-1c24-4227-9bc5-45a9bfd1ceb9 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:49.095938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15589d1-0daa-4cb9-8686-71cf85b9f4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:49.097049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15589d1-0daa-4cb9-8686-71cf85b9f4ba admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:49.097332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15589d1-0daa-4cb9-8686-71cf85b9f4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:49.097683 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15589d1-0daa-4cb9-8686-71cf85b9f4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:49.100049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15589d1-0daa-4cb9-8686-71cf85b9f4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:49.100049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15589d1-0daa-4cb9-8686-71cf85b9f4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:49.102658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15589d1-0daa-4cb9-8686-71cf85b9f4ba admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:49.104504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23d7d-1c24-4227-9bc5-45a9bfd1ceb9 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:49.112065 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e21c03-4f29-4566-b68e-698a75ea1bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:49.112845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e21c03-4f29-4566-b68e-698a75ea1bec admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:49.113124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e21c03-4f29-4566-b68e-698a75ea1bec admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:49.113394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e21c03-4f29-4566-b68e-698a75ea1bec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:49.121201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 273/567] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:49.127394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e21c03-4f29-4566-b68e-698a75ea1bec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:49.127617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15589d1-0daa-4cb9-8686-71cf85b9f4ba admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:49.129830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e21c03-4f29-4566-b68e-698a75ea1bec admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:49.142393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15589d1-0daa-4cb9-8686-71cf85b9f4ba admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:49.145113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-66e21c03-4f29-4566-b68e-698a75ea1bec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:49.146472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 295/568] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:49.147632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaa3da-8970-49ea-9f94-5955e89b5047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:49.148559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa3da-8970-49ea-9f94-5955e89b5047 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:49.148940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa3da-8970-49ea-9f94-5955e89b5047 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:49.149319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa3da-8970-49ea-9f94-5955e89b5047 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:49.153309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e21c03-4f29-4566-b68e-698a75ea1bec admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:49.156960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaa3da-8970-49ea-9f94-5955e89b5047 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:49.159322 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaa3da-8970-49ea-9f94-5955e89b5047 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:49.165391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e21c03-4f29-4566-b68e-698a75ea1bec admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:49.170336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f49e5-f361-4410-af38-653d366d5f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:49.171185 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f49e5-f361-4410-af38-653d366d5f46 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:49.171617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f49e5-f361-4410-af38-653d366d5f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:49.172059 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f49e5-f361-4410-af38-653d366d5f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:49.173007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f49e5-f361-4410-af38-653d366d5f46 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:49.173465 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f49e5-f361-4410-af38-653d366d5f46 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:49.175549 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f49e5-f361-4410-af38-653d366d5f46 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:49.176854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-80eaa3da-8970-49ea-9f94-5955e89b5047 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:49.178808 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 274/569] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:49.184950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaa3da-8970-49ea-9f94-5955e89b5047 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:49.194401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 296/570] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:49.195427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaa3da-8970-49ea-9f94-5955e89b5047 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:49.201655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f49e5-f361-4410-af38-653d366d5f46 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:49.203665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a1d4c-9dfe-4b06-87a9-54af45b66d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:49.210749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a1d4c-9dfe-4b06-87a9-54af45b66d2f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:49.210749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a1d4c-9dfe-4b06-87a9-54af45b66d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:49.210749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a1d4c-9dfe-4b06-87a9-54af45b66d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:49.210749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a1d4c-9dfe-4b06-87a9-54af45b66d2f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:49.214758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a1d4c-9dfe-4b06-87a9-54af45b66d2f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:49.214758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a1d4c-9dfe-4b06-87a9-54af45b66d2f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:49.220489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f49e5-f361-4410-af38-653d366d5f46 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:49.226307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f79b-6b12-4979-b4af-60125e950739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:49.227315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f79b-6b12-4979-b4af-60125e950739 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:49.228170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f79b-6b12-4979-b4af-60125e950739 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:49.228528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f79b-6b12-4979-b4af-60125e950739 admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/861c258c3fbf470fac4af9966ac5f0c5/roles/a7290d45b88b4a14ab8a17f724c7adf9` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:49.241248 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 275/571] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:49.246191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f79b-6b12-4979-b4af-60125e950739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=861c258c3fbf470fac4af9966ac5f0c5, role_id=a7290d45b88b4a14ab8a17f724c7adf9)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:49.248052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a1d4c-9dfe-4b06-87a9-54af45b66d2f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:49.249536 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f79b-6b12-4979-b4af-60125e950739 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:49.261219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a1d4c-9dfe-4b06-87a9-54af45b66d2f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:49.266990 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34f207-6697-433d-9f19-922885513bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:49.268092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34f207-6697-433d-9f19-922885513bae admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:49.268390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34f207-6697-433d-9f19-922885513bae admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:49.268707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34f207-6697-433d-9f19-922885513bae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:49.269549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34f207-6697-433d-9f19-922885513bae admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=a08ace1a65c040bf97108a1660f962ee) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:49.270565 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34f207-6697-433d-9f19-922885513bae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:49.273281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34f207-6697-433d-9f19-922885513bae admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:49.278823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 297/572] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:49 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/861c258c3fbf470fac4af9966ac5f0c5/roles/a7290d45b88b4a14ab8a17f724c7adf9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:49.280405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 276/573] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:49 2021] GET /identity/v3/role_assignments?user.id=a08ace1a65c040bf97108a1660f962ee&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:50.395993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57bde6-2f40-46cb-b5aa-c13287a213f5 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:50.397050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57bde6-2f40-46cb-b5aa-c13287a213f5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:50.397558 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57bde6-2f40-46cb-b5aa-c13287a213f5 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:50.399829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 298/574] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:50.406229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836651e-34b4-4703-9492-c3c205619b14 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:50.407105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836651e-34b4-4703-9492-c3c205619b14 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:50.407586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836651e-34b4-4703-9492-c3c205619b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:50.435918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d836651e-34b4-4703-9492-c3c205619b14 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:50.437531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d836651e-34b4-4703-9492-c3c205619b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:50.525217 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 277/575] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:50.576411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57bde6-2f40-46cb-b5aa-c13287a213f5 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:50.598494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57bde6-2f40-46cb-b5aa-c13287a213f5 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:50.606817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3747d3-4ad7-44b7-ba0d-c4d0f0bbe247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:50.607874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3747d3-4ad7-44b7-ba0d-c4d0f0bbe247 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:50.608361 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3747d3-4ad7-44b7-ba0d-c4d0f0bbe247 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:50.608834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3747d3-4ad7-44b7-ba0d-c4d0f0bbe247 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:50.626848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3747d3-4ad7-44b7-ba0d-c4d0f0bbe247 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:50.634014 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-ec3747d3-4ad7-44b7-ba0d-c4d0f0bbe247 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:50.635453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 299/576] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:50.642513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836651e-34b4-4703-9492-c3c205619b14 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:50.655780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836651e-34b4-4703-9492-c3c205619b14 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:50.668190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10e8f2-2457-49b2-8b68-bead06c22cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:50.668868 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10e8f2-2457-49b2-8b68-bead06c22cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:50.669149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10e8f2-2457-49b2-8b68-bead06c22cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:50.669426 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10e8f2-2457-49b2-8b68-bead06c22cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:50.670176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10e8f2-2457-49b2-8b68-bead06c22cb8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:50.670482 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10e8f2-2457-49b2-8b68-bead06c22cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:50.672162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10e8f2-2457-49b2-8b68-bead06c22cb8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:50.688755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 278/577] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:50.695219 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3747d3-4ad7-44b7-ba0d-c4d0f0bbe247 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:50.708100 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3747d3-4ad7-44b7-ba0d-c4d0f0bbe247 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:50.716761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dc591-255e-4375-af7b-341a52abac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:50.717553 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc591-255e-4375-af7b-341a52abac28 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:50.717831 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc591-255e-4375-af7b-341a52abac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:50.718102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc591-255e-4375-af7b-341a52abac28 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:50.734186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dc591-255e-4375-af7b-341a52abac28 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:50.736058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dc591-255e-4375-af7b-341a52abac28 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:50.768597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-630dc591-255e-4375-af7b-341a52abac28 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:50.770352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 300/578] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:50.776832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10e8f2-2457-49b2-8b68-bead06c22cb8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:50.791601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10e8f2-2457-49b2-8b68-bead06c22cb8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:50.804169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d7da7-160c-40f1-875d-41860e08a3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:50.804849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d7da7-160c-40f1-875d-41860e08a3ae admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:50.805121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d7da7-160c-40f1-875d-41860e08a3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:50.805399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d7da7-160c-40f1-875d-41860e08a3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:50.806120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d7da7-160c-40f1-875d-41860e08a3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:50.806425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d7da7-160c-40f1-875d-41860e08a3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:50.808034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d7da7-160c-40f1-875d-41860e08a3ae admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:50.827653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 279/579] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:50.834297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dc591-255e-4375-af7b-341a52abac28 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:50.844011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dc591-255e-4375-af7b-341a52abac28 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:50.854781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b9eba-ff60-4a33-9004-73d011bf67bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:50.855567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b9eba-ff60-4a33-9004-73d011bf67bc admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:50.855846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b9eba-ff60-4a33-9004-73d011bf67bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:50.856147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b9eba-ff60-4a33-9004-73d011bf67bc admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:50.870722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b9eba-ff60-4a33-9004-73d011bf67bc admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:50.872724 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b9eba-ff60-4a33-9004-73d011bf67bc admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:50.890592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-4c2b9eba-ff60-4a33-9004-73d011bf67bc admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 01:15:50.892088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 301/580] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 25 01:15:50 2021] GET /identity/v3/users/nova => generated 82 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:50.898815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d7da7-160c-40f1-875d-41860e08a3ae admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:50.915810 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d7da7-160c-40f1-875d-41860e08a3ae admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:50.924220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e479ef9-3f39-4d22-99b1-8c4fce5fe2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:50.924893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e479ef9-3f39-4d22-99b1-8c4fce5fe2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:50.925172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e479ef9-3f39-4d22-99b1-8c4fce5fe2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:50.925444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e479ef9-3f39-4d22-99b1-8c4fce5fe2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:50.926315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e479ef9-3f39-4d22-99b1-8c4fce5fe2a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:50.926622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e479ef9-3f39-4d22-99b1-8c4fce5fe2a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:50.928475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e479ef9-3f39-4d22-99b1-8c4fce5fe2a9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:50.957767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 280/581] 10.222.0.23 () {56 vars in 1155 bytes} [Wed Aug 25 01:15:50 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:50.964103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b9eba-ff60-4a33-9004-73d011bf67bc admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:50.974535 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b9eba-ff60-4a33-9004-73d011bf67bc admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:50.991349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6c817-cc51-47a4-bd73-f638b6beeae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:50.992027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6c817-cc51-47a4-bd73-f638b6beeae3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:50.992279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6c817-cc51-47a4-bd73-f638b6beeae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:50.992555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6c817-cc51-47a4-bd73-f638b6beeae3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.001245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6c817-cc51-47a4-bd73-f638b6beeae3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.003016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6c817-cc51-47a4-bd73-f638b6beeae3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.019150 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 302/582] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:51.026302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e479ef9-3f39-4d22-99b1-8c4fce5fe2a9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.043063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e479ef9-3f39-4d22-99b1-8c4fce5fe2a9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.052973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1f209-237b-4f24-9a3e-37185c277f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.054190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1f209-237b-4f24-9a3e-37185c277f24 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.054727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1f209-237b-4f24-9a3e-37185c277f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.055292 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1f209-237b-4f24-9a3e-37185c277f24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.075169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1f209-237b-4f24-9a3e-37185c277f24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.077345 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1f209-237b-4f24-9a3e-37185c277f24 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.102518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-57d1f209-237b-4f24-9a3e-37185c277f24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:51.109236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 281/583] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:51.110864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6c817-cc51-47a4-bd73-f638b6beeae3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.124287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6fce-6095-4c09-a3a7-7798d3e5a9a4 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.124910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6fce-6095-4c09-a3a7-7798d3e5a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.125391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6fce-6095-4c09-a3a7-7798d3e5a9a4 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.127109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6c817-cc51-47a4-bd73-f638b6beeae3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.127675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 282/584] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:51.135022 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7bec-9ff8-47d4-9406-62e0991bcca4 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.135633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7bec-9ff8-47d4-9406-62e0991bcca4 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.136120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7bec-9ff8-47d4-9406-62e0991bcca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.143709 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397ebd-a797-4cb1-9871-e68059ffd85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.150732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397ebd-a797-4cb1-9871-e68059ffd85a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.150732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397ebd-a797-4cb1-9871-e68059ffd85a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.150732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397ebd-a797-4cb1-9871-e68059ffd85a admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.150732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf397ebd-a797-4cb1-9871-e68059ffd85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:51.150732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf397ebd-a797-4cb1-9871-e68059ffd85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.150732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf397ebd-a797-4cb1-9871-e68059ffd85a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.162253 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-023c7bec-9ff8-47d4-9406-62e0991bcca4 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:51.163876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 303/585] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:51.165172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-023c7bec-9ff8-47d4-9406-62e0991bcca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:51.176555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397ebd-a797-4cb1-9871-e68059ffd85a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.178318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 283/586] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:51.199726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397ebd-a797-4cb1-9871-e68059ffd85a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.203730 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c7bec-9ff8-47d4-9406-62e0991bcca4 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.208896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd9eb6-4c5c-412f-a647-5727260e10ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.209938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd9eb6-4c5c-412f-a647-5727260e10ec admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.210365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd9eb6-4c5c-412f-a647-5727260e10ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.210899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd9eb6-4c5c-412f-a647-5727260e10ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.218637 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd9eb6-4c5c-412f-a647-5727260e10ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.220869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd9eb6-4c5c-412f-a647-5727260e10ec admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.221296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c7bec-9ff8-47d4-9406-62e0991bcca4 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.235786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-eefd9eb6-4c5c-412f-a647-5727260e10ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:51.237645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 304/587] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:51.239891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c654b87-bafa-45a4-bea6-48841bc16d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.240684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654b87-bafa-45a4-bea6-48841bc16d77 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.240970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654b87-bafa-45a4-bea6-48841bc16d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.241235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654b87-bafa-45a4-bea6-48841bc16d77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.244028 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd9eb6-4c5c-412f-a647-5727260e10ec admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.255443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd9eb6-4c5c-412f-a647-5727260e10ec admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.260403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452fd4d-0893-41f2-8534-a9e63db46cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.261233 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452fd4d-0893-41f2-8534-a9e63db46cfd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.261692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452fd4d-0893-41f2-8534-a9e63db46cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.262119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452fd4d-0893-41f2-8534-a9e63db46cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.263176 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452fd4d-0893-41f2-8534-a9e63db46cfd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:51.263872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452fd4d-0893-41f2-8534-a9e63db46cfd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.265531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c654b87-bafa-45a4-bea6-48841bc16d77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.266184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452fd4d-0893-41f2-8534-a9e63db46cfd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.267383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c654b87-bafa-45a4-bea6-48841bc16d77 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.287195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-7c654b87-bafa-45a4-bea6-48841bc16d77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:51.288967 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 284/588] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:51.290519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 305/589] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:51.296807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c654b87-bafa-45a4-bea6-48841bc16d77 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.297512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452fd4d-0893-41f2-8534-a9e63db46cfd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.307909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452fd4d-0893-41f2-8534-a9e63db46cfd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.308982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c654b87-bafa-45a4-bea6-48841bc16d77 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.312960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0d897-a35c-48a3-a095-c829f4f25a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.313846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0d897-a35c-48a3-a095-c829f4f25a23 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.314330 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0d897-a35c-48a3-a095-c829f4f25a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.314771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0d897-a35c-48a3-a095-c829f4f25a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.315769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0d897-a35c-48a3-a095-c829f4f25a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:51.316234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0d897-a35c-48a3-a095-c829f4f25a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.318645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0d897-a35c-48a3-a095-c829f4f25a23 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.327996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31612a76-9d86-4385-b259-c12514a4b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.328661 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612a76-9d86-4385-b259-c12514a4b4fa admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.328941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612a76-9d86-4385-b259-c12514a4b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.329210 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612a76-9d86-4385-b259-c12514a4b4fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.330494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31612a76-9d86-4385-b259-c12514a4b4fa admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=d061cf5060334e79ab4f22518d37116f) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:51.335008 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31612a76-9d86-4385-b259-c12514a4b4fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.339081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 306/590] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:51.339375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31612a76-9d86-4385-b259-c12514a4b4fa admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.348303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0d897-a35c-48a3-a095-c829f4f25a23 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.356470 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 285/591] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:51 2021] GET /identity/v3/role_assignments?user.id=d061cf5060334e79ab4f22518d37116f&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 259 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:51.361752 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0d897-a35c-48a3-a095-c829f4f25a23 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.366795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466c4ec-9d3d-454d-af33-205733f9a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.367748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466c4ec-9d3d-454d-af33-205733f9a092 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.368194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466c4ec-9d3d-454d-af33-205733f9a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.368598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466c4ec-9d3d-454d-af33-205733f9a092 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.369518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466c4ec-9d3d-454d-af33-205733f9a092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.371617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466c4ec-9d3d-454d-af33-205733f9a092 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.419340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 307/592] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:15:51 2021] POST /identity/v3/users => generated 254 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:51.680538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad54f43-d449-4d55-a9d5-e8a0b77dd357 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.681426 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad54f43-d449-4d55-a9d5-e8a0b77dd357 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.681849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad54f43-d449-4d55-a9d5-e8a0b77dd357 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.684034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 286/593] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:51.689933 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dc3b8-c95b-4120-b219-2c198273e649 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.690462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dc3b8-c95b-4120-b219-2c198273e649 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.690910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dc3b8-c95b-4120-b219-2c198273e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.716654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-255dc3b8-c95b-4120-b219-2c198273e649 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:51.718252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-255dc3b8-c95b-4120-b219-2c198273e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:51.726900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 308/594] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:51.762960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad54f43-d449-4d55-a9d5-e8a0b77dd357 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.780283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad54f43-d449-4d55-a9d5-e8a0b77dd357 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.786062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b633a1-4e74-4d14-8a3c-6b3fb72dcab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.787191 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b633a1-4e74-4d14-8a3c-6b3fb72dcab3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.787735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b633a1-4e74-4d14-8a3c-6b3fb72dcab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.788208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b633a1-4e74-4d14-8a3c-6b3fb72dcab3 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.789067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b633a1-4e74-4d14-8a3c-6b3fb72dcab3 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.790318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-85b633a1-4e74-4d14-8a3c-6b3fb72dcab3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:51.790318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:51.790318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:51.791573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b633a1-4e74-4d14-8a3c-6b3fb72dcab3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.810702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-85b633a1-4e74-4d14-8a3c-6b3fb72dcab3 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 01:15:51.811434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 287/595] 10.222.0.23 () {56 vars in 1151 bytes} [Wed Aug 25 01:15:51 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:51.818703 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dc3b8-c95b-4120-b219-2c198273e649 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.836958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dc3b8-c95b-4120-b219-2c198273e649 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.846703 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e4a34-fbd6-484c-a358-048068d0d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.848585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e4a34-fbd6-484c-a358-048068d0d6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.849079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e4a34-fbd6-484c-a358-048068d0d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.849556 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e4a34-fbd6-484c-a358-048068d0d6a2 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.858711 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e4a34-fbd6-484c-a358-048068d0d6a2 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:51.859615 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e4a34-fbd6-484c-a358-048068d0d6a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.860891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-d83e4a34-fbd6-484c-a358-048068d0d6a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:51.860891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:51.860891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:51.862128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e4a34-fbd6-484c-a358-048068d0d6a2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.870839 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 309/596] 10.222.0.23 () {56 vars in 1146 bytes} [Wed Aug 25 01:15:51 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:51.877401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b633a1-4e74-4d14-8a3c-6b3fb72dcab3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:51.893288 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b633a1-4e74-4d14-8a3c-6b3fb72dcab3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:51.900786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ec26e-be1b-4c42-a57f-eb7f3fb0e2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:51.901830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ec26e-be1b-4c42-a57f-eb7f3fb0e2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.902314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ec26e-be1b-4c42-a57f-eb7f3fb0e2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.902869 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ec26e-be1b-4c42-a57f-eb7f3fb0e2c8 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.903815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ec26e-be1b-4c42-a57f-eb7f3fb0e2c8 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:51.904340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ec26e-be1b-4c42-a57f-eb7f3fb0e2c8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:51.905629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-b36ec26e-be1b-4c42-a57f-eb7f3fb0e2c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:51.905629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:51.905629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:51.907007 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ec26e-be1b-4c42-a57f-eb7f3fb0e2c8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:51.917098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 288/597] 10.222.0.23 () {56 vars in 1146 bytes} [Wed Aug 25 01:15:51 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:51.924398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdea97-92c7-4985-88e6-d65d83327d93 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.924996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdea97-92c7-4985-88e6-d65d83327d93 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.925488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdea97-92c7-4985-88e6-d65d83327d93 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.928138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 310/598] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:51.935083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc3846-f15a-4da8-8d0a-dae8f17ab29d None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:51.935382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc3846-f15a-4da8-8d0a-dae8f17ab29d None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:51.935637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc3846-f15a-4da8-8d0a-dae8f17ab29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:51.961322 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-82fc3846-f15a-4da8-8d0a-dae8f17ab29d None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:51.962532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-82fc3846-f15a-4da8-8d0a-dae8f17ab29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:51.981134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 289/599] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:52.009660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdea97-92c7-4985-88e6-d65d83327d93 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.027021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdea97-92c7-4985-88e6-d65d83327d93 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.032104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e6678-5c91-46d3-b6b0-557af7b28a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.033361 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e6678-5c91-46d3-b6b0-557af7b28a8f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.033887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e6678-5c91-46d3-b6b0-557af7b28a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.034481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e6678-5c91-46d3-b6b0-557af7b28a8f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.059663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e6678-5c91-46d3-b6b0-557af7b28a8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:52.067500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-532e6678-5c91-46d3-b6b0-557af7b28a8f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:52.069168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 311/600] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:52.075788 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc3846-f15a-4da8-8d0a-dae8f17ab29d None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.092994 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc3846-f15a-4da8-8d0a-dae8f17ab29d None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.100822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f80e-acef-4475-b269-89f9606ee658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.101500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f80e-acef-4475-b269-89f9606ee658 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.101785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f80e-acef-4475-b269-89f9606ee658 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.102062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f80e-acef-4475-b269-89f9606ee658 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.102848 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3f80e-acef-4475-b269-89f9606ee658 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:52.103154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3f80e-acef-4475-b269-89f9606ee658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.104738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3f80e-acef-4475-b269-89f9606ee658 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.114583 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 290/601] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:52.120847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e6678-5c91-46d3-b6b0-557af7b28a8f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.131170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e6678-5c91-46d3-b6b0-557af7b28a8f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.135987 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d89639-909f-4e26-bb8c-f63b7368a9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.137105 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d89639-909f-4e26-bb8c-f63b7368a9de admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.137609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d89639-909f-4e26-bb8c-f63b7368a9de admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.138084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d89639-909f-4e26-bb8c-f63b7368a9de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.149795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d89639-909f-4e26-bb8c-f63b7368a9de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.152002 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d89639-909f-4e26-bb8c-f63b7368a9de admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.169691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-09d89639-909f-4e26-bb8c-f63b7368a9de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:52.171217 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 312/602] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:52.178408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f80e-acef-4475-b269-89f9606ee658 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.188134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3f80e-acef-4475-b269-89f9606ee658 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.198758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51dfcb-f543-4b9f-988b-3ce78dd07f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.199417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51dfcb-f543-4b9f-988b-3ce78dd07f99 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.199698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51dfcb-f543-4b9f-988b-3ce78dd07f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.199968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51dfcb-f543-4b9f-988b-3ce78dd07f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.200689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51dfcb-f543-4b9f-988b-3ce78dd07f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:52.200995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51dfcb-f543-4b9f-988b-3ce78dd07f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.202724 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51dfcb-f543-4b9f-988b-3ce78dd07f99 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.217894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 291/603] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:52.224778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d89639-909f-4e26-bb8c-f63b7368a9de admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.238542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d89639-909f-4e26-bb8c-f63b7368a9de admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.245391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d48cc-13f5-4fcb-a49b-0d6257a40750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.246201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d48cc-13f5-4fcb-a49b-0d6257a40750 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.246482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d48cc-13f5-4fcb-a49b-0d6257a40750 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.246802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d48cc-13f5-4fcb-a49b-0d6257a40750 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.256097 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d48cc-13f5-4fcb-a49b-0d6257a40750 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.258134 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d48cc-13f5-4fcb-a49b-0d6257a40750 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.277716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-494d48cc-13f5-4fcb-a49b-0d6257a40750 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 01:15:52.282870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 313/604] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:52.289710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51dfcb-f543-4b9f-988b-3ce78dd07f99 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.299432 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51dfcb-f543-4b9f-988b-3ce78dd07f99 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.306668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb062874-c66e-409d-bb15-7dd666812ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.307342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb062874-c66e-409d-bb15-7dd666812ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.307625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb062874-c66e-409d-bb15-7dd666812ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.307899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb062874-c66e-409d-bb15-7dd666812ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.308728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb062874-c66e-409d-bb15-7dd666812ea7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:52.309034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb062874-c66e-409d-bb15-7dd666812ea7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.310888 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb062874-c66e-409d-bb15-7dd666812ea7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.315784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227197-85ea-4b12-bbce-c49c2160a3b6 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.315784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227197-85ea-4b12-bbce-c49c2160a3b6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.315784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227197-85ea-4b12-bbce-c49c2160a3b6 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.316308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 314/605] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:52.322091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ed53f-ef10-46bf-b980-3222a4f6e07d None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.322551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ed53f-ef10-46bf-b980-3222a4f6e07d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.323008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ed53f-ef10-46bf-b980-3222a4f6e07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.339039 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 292/606] 10.222.0.23 () {56 vars in 1157 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:52.341983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a11ed53f-ef10-46bf-b980-3222a4f6e07d None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:52.343418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a11ed53f-ef10-46bf-b980-3222a4f6e07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:52.345035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb062874-c66e-409d-bb15-7dd666812ea7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.358722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb062874-c66e-409d-bb15-7dd666812ea7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.358947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 315/607] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:52.375386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37207f05-cad6-4c2e-b37b-653385948d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.376050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37207f05-cad6-4c2e-b37b-653385948d9b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.376334 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37207f05-cad6-4c2e-b37b-653385948d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.376607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37207f05-cad6-4c2e-b37b-653385948d9b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.379634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ed53f-ef10-46bf-b980-3222a4f6e07d None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.385268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37207f05-cad6-4c2e-b37b-653385948d9b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.387483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37207f05-cad6-4c2e-b37b-653385948d9b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.389688 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ed53f-ef10-46bf-b980-3222a4f6e07d None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.395207 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4866b-beb9-4c46-9cc0-03e0def87d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.396158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4866b-beb9-4c46-9cc0-03e0def87d25 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.396619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4866b-beb9-4c46-9cc0-03e0def87d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.397121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4866b-beb9-4c46-9cc0-03e0def87d25 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.397942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4866b-beb9-4c46-9cc0-03e0def87d25 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.399183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-eaa4866b-beb9-4c46-9cc0-03e0def87d25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:52.399183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:52.399183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:52.400439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4866b-beb9-4c46-9cc0-03e0def87d25 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.405157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 293/608] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:15:52.411742 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37207f05-cad6-4c2e-b37b-653385948d9b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.415253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-eaa4866b-beb9-4c46-9cc0-03e0def87d25 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 01:15:52.420146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37207f05-cad6-4c2e-b37b-653385948d9b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.420343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 316/609] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:52.427973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4866b-beb9-4c46-9cc0-03e0def87d25 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.435731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bd4af-46e6-46b9-a5a4-d1f485fd3024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.436737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bd4af-46e6-46b9-a5a4-d1f485fd3024 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.437170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bd4af-46e6-46b9-a5a4-d1f485fd3024 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.438438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bd4af-46e6-46b9-a5a4-d1f485fd3024 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.448628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4866b-beb9-4c46-9cc0-03e0def87d25 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.458738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bd4af-46e6-46b9-a5a4-d1f485fd3024 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.459527 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a64c4-0529-46e7-87a5-ea7cdb51f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.461025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a64c4-0529-46e7-87a5-ea7cdb51f40c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.461999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a64c4-0529-46e7-87a5-ea7cdb51f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.462421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a64c4-0529-46e7-87a5-ea7cdb51f40c admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.463906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bd4af-46e6-46b9-a5a4-d1f485fd3024 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.464314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a64c4-0529-46e7-87a5-ea7cdb51f40c admin admin] RBAC: Adding query filter params (name=network) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:52.465215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a64c4-0529-46e7-87a5-ea7cdb51f40c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.468395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a64c4-0529-46e7-87a5-ea7cdb51f40c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.476870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 317/610] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/services?name=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:52.485745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a64c4-0529-46e7-87a5-ea7cdb51f40c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.502624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-1d8bd4af-46e6-46b9-a5a4-d1f485fd3024 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:52.503223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a64c4-0529-46e7-87a5-ea7cdb51f40c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.504249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 294/611] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:52.508647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96716-c1f2-44e7-8fbc-af8fe68ffe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.509555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96716-c1f2-44e7-8fbc-af8fe68ffe96 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.510031 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96716-c1f2-44e7-8fbc-af8fe68ffe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.510447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc96716-c1f2-44e7-8fbc-af8fe68ffe96 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.511376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc96716-c1f2-44e7-8fbc-af8fe68ffe96 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:52.511977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc96716-c1f2-44e7-8fbc-af8fe68ffe96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.514761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc96716-c1f2-44e7-8fbc-af8fe68ffe96 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.515656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bd4af-46e6-46b9-a5a4-d1f485fd3024 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.526818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 318/612] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/services?type=network => generated 124 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:52.545505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bd4af-46e6-46b9-a5a4-d1f485fd3024 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.560904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075e218-0ac9-47b5-869e-58df93b01e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.561579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075e218-0ac9-47b5-869e-58df93b01e9a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.561865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075e218-0ac9-47b5-869e-58df93b01e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.562142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075e218-0ac9-47b5-869e-58df93b01e9a admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.562917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075e218-0ac9-47b5-869e-58df93b01e9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:52.563225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075e218-0ac9-47b5-869e-58df93b01e9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.564855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075e218-0ac9-47b5-869e-58df93b01e9a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.584968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 295/613] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:52.590816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96716-c1f2-44e7-8fbc-af8fe68ffe96 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.605011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc96716-c1f2-44e7-8fbc-af8fe68ffe96 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.610151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac56b66-2deb-43ed-ba17-13dab1f7221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.611352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac56b66-2deb-43ed-ba17-13dab1f7221b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.611789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac56b66-2deb-43ed-ba17-13dab1f7221b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.612213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac56b66-2deb-43ed-ba17-13dab1f7221b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.620343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac56b66-2deb-43ed-ba17-13dab1f7221b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.622547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac56b66-2deb-43ed-ba17-13dab1f7221b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.636889 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-4ac56b66-2deb-43ed-ba17-13dab1f7221b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:52.638670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 319/614] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:52.646736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075e218-0ac9-47b5-869e-58df93b01e9a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.664029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075e218-0ac9-47b5-869e-58df93b01e9a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.675163 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9623c-57ff-40a3-b1c0-876e1050df5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.675894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9623c-57ff-40a3-b1c0-876e1050df5d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.676186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9623c-57ff-40a3-b1c0-876e1050df5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.676467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9623c-57ff-40a3-b1c0-876e1050df5d admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.677268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9623c-57ff-40a3-b1c0-876e1050df5d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:52.677579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9623c-57ff-40a3-b1c0-876e1050df5d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.679465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9623c-57ff-40a3-b1c0-876e1050df5d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.704120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 296/615] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:52.711301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac56b66-2deb-43ed-ba17-13dab1f7221b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:52.722630 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac56b66-2deb-43ed-ba17-13dab1f7221b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:52.730823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b5906-fc38-4c3a-8758-1475169adaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:52.731488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5906-fc38-4c3a-8758-1475169adaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:52.731799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5906-fc38-4c3a-8758-1475169adaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:52.732057 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5906-fc38-4c3a-8758-1475169adaf9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:52.732893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b5906-fc38-4c3a-8758-1475169adaf9 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=861c258c3fbf470fac4af9966ac5f0c5) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:52.733201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b5906-fc38-4c3a-8758-1475169adaf9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:52.735068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b5906-fc38-4c3a-8758-1475169adaf9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:52.742557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 320/616] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:52 2021] GET /identity/v3/role_assignments?user.id=861c258c3fbf470fac4af9966ac5f0c5&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:53.984054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d50462-ffb0-4955-95c5-b1b216e3a0eb None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:53.984575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d50462-ffb0-4955-95c5-b1b216e3a0eb None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:53.984683 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d50462-ffb0-4955-95c5-b1b216e3a0eb None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:53.986589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 297/617] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:53.993159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fbab0-5316-490e-8d5c-0d179cff4b13 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:53.993562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fbab0-5316-490e-8d5c-0d179cff4b13 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:53.993791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fbab0-5316-490e-8d5c-0d179cff4b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.018738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-622fbab0-5316-490e-8d5c-0d179cff4b13 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:54.020011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-622fbab0-5316-490e-8d5c-0d179cff4b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:54.034436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 321/618] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:54.070442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d50462-ffb0-4955-95c5-b1b216e3a0eb None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.088408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d50462-ffb0-4955-95c5-b1b216e3a0eb None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.095838 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c905-5fbc-4bd2-bab9-2ea9f141ee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.096628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c905-5fbc-4bd2-bab9-2ea9f141ee7b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.096910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c905-5fbc-4bd2-bab9-2ea9f141ee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.097188 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c905-5fbc-4bd2-bab9-2ea9f141ee7b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.112516 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804c905-5fbc-4bd2-bab9-2ea9f141ee7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:54.119812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-3804c905-5fbc-4bd2-bab9-2ea9f141ee7b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:54.121332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 298/619] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:54.127787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fbab0-5316-490e-8d5c-0d179cff4b13 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.136899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fbab0-5316-490e-8d5c-0d179cff4b13 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.141636 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556b728-0aef-49fd-8b4c-0197a84f0a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.142288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556b728-0aef-49fd-8b4c-0197a84f0a2b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.142568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556b728-0aef-49fd-8b4c-0197a84f0a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.142883 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556b728-0aef-49fd-8b4c-0197a84f0a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.143627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556b728-0aef-49fd-8b4c-0197a84f0a2b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:54.143933 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556b728-0aef-49fd-8b4c-0197a84f0a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.145562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556b728-0aef-49fd-8b4c-0197a84f0a2b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.158167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 322/620] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:54.164603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c905-5fbc-4bd2-bab9-2ea9f141ee7b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.180910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c905-5fbc-4bd2-bab9-2ea9f141ee7b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.191296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766344ec-08ee-445f-a84a-eb3a19348c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.192197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766344ec-08ee-445f-a84a-eb3a19348c0a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.192486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766344ec-08ee-445f-a84a-eb3a19348c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.192762 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766344ec-08ee-445f-a84a-eb3a19348c0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.213310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766344ec-08ee-445f-a84a-eb3a19348c0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.215193 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766344ec-08ee-445f-a84a-eb3a19348c0a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.235400 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-766344ec-08ee-445f-a84a-eb3a19348c0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:54.236811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 299/621] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:54.243442 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556b728-0aef-49fd-8b4c-0197a84f0a2b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.261147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc581-9af1-42e9-9637-20049514fb23 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.261433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc581-9af1-42e9-9637-20049514fb23 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.261694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc581-9af1-42e9-9637-20049514fb23 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.261899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556b728-0aef-49fd-8b4c-0197a84f0a2b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.263986 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 300/622] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:54.271785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc24439-74b7-4990-ae82-6f5c671263c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.272404 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afa07d-ae57-484a-986e-b56b0eac72bb None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.272598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc24439-74b7-4990-ae82-6f5c671263c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.272779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc24439-74b7-4990-ae82-6f5c671263c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.272921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afa07d-ae57-484a-986e-b56b0eac72bb None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.273063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc24439-74b7-4990-ae82-6f5c671263c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.273293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afa07d-ae57-484a-986e-b56b0eac72bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.273666 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc24439-74b7-4990-ae82-6f5c671263c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:54.273973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc24439-74b7-4990-ae82-6f5c671263c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.275586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc24439-74b7-4990-ae82-6f5c671263c1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.296984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-12afa07d-ae57-484a-986e-b56b0eac72bb None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:54.298285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-12afa07d-ae57-484a-986e-b56b0eac72bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:54.302779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 323/623] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:54.306603 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc24439-74b7-4990-ae82-6f5c671263c1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.319112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc24439-74b7-4990-ae82-6f5c671263c1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.322094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 301/624] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:54.330252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133c9a5-0abf-4a98-8f7f-540828875858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.331163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133c9a5-0abf-4a98-8f7f-540828875858 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.331517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133c9a5-0abf-4a98-8f7f-540828875858 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.331868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133c9a5-0abf-4a98-8f7f-540828875858 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.346465 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133c9a5-0abf-4a98-8f7f-540828875858 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.349116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133c9a5-0abf-4a98-8f7f-540828875858 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.370086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-3133c9a5-0abf-4a98-8f7f-540828875858 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 01:15:54.370429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 324/625] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:54.378190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afa07d-ae57-484a-986e-b56b0eac72bb None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.385514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133c9a5-0abf-4a98-8f7f-540828875858 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.388147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afa07d-ae57-484a-986e-b56b0eac72bb None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.399410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9114330-3c8c-4bc3-b6d3-48b3926a9470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.400280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114330-3c8c-4bc3-b6d3-48b3926a9470 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.400665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114330-3c8c-4bc3-b6d3-48b3926a9470 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.401005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114330-3c8c-4bc3-b6d3-48b3926a9470 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.408214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133c9a5-0abf-4a98-8f7f-540828875858 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.417395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fa7ce-bc5c-4421-be6c-e35a999c4b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.418525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fa7ce-bc5c-4421-be6c-e35a999c4b78 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.419087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fa7ce-bc5c-4421-be6c-e35a999c4b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.420060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9114330-3c8c-4bc3-b6d3-48b3926a9470 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:54.420388 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fa7ce-bc5c-4421-be6c-e35a999c4b78 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.422531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fa7ce-bc5c-4421-be6c-e35a999c4b78 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:54.422985 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fa7ce-bc5c-4421-be6c-e35a999c4b78 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.429530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fa7ce-bc5c-4421-be6c-e35a999c4b78 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.433031 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-d9114330-3c8c-4bc3-b6d3-48b3926a9470 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:54.439514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 302/626] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:54.446611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9114330-3c8c-4bc3-b6d3-48b3926a9470 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.460359 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 325/627] 10.222.0.23 () {56 vars in 1155 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:54.462521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9114330-3c8c-4bc3-b6d3-48b3926a9470 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.465401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fa7ce-bc5c-4421-be6c-e35a999c4b78 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.476168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef62319-9c23-485c-8277-5e33e450d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.477016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef62319-9c23-485c-8277-5e33e450d308 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.477447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef62319-9c23-485c-8277-5e33e450d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.477825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef62319-9c23-485c-8277-5e33e450d308 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.478698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef62319-9c23-485c-8277-5e33e450d308 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:54.479324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef62319-9c23-485c-8277-5e33e450d308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.481464 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fa7ce-bc5c-4421-be6c-e35a999c4b78 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.483259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef62319-9c23-485c-8277-5e33e450d308 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.495970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5e758-838f-4dd4-b732-817678614cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.496901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5e758-838f-4dd4-b732-817678614cfa admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.497300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5e758-838f-4dd4-b732-817678614cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.497761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5e758-838f-4dd4-b732-817678614cfa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.503089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 303/628] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:54.511369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5e758-838f-4dd4-b732-817678614cfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.513534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5e758-838f-4dd4-b732-817678614cfa admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.515857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef62319-9c23-485c-8277-5e33e450d308 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.528412 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef62319-9c23-485c-8277-5e33e450d308 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.536641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61911c-8eda-4d7d-beda-e935ed76fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.537464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61911c-8eda-4d7d-beda-e935ed76fc65 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.537713 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61911c-8eda-4d7d-beda-e935ed76fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.537988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61911c-8eda-4d7d-beda-e935ed76fc65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.544671 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-64e5e758-838f-4dd4-b732-817678614cfa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:54.546247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 326/629] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:54.553180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5e758-838f-4dd4-b732-817678614cfa admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.556628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61911c-8eda-4d7d-beda-e935ed76fc65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.558516 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61911c-8eda-4d7d-beda-e935ed76fc65 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.564736 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5e758-838f-4dd4-b732-817678614cfa admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.577209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-cd61911c-8eda-4d7d-beda-e935ed76fc65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:54.578904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 304/630] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:54.584857 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467f6f-e0e9-4f9d-8c8f-20381fbc1609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.585104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61911c-8eda-4d7d-beda-e935ed76fc65 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.585543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467f6f-e0e9-4f9d-8c8f-20381fbc1609 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.585823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467f6f-e0e9-4f9d-8c8f-20381fbc1609 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.586098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467f6f-e0e9-4f9d-8c8f-20381fbc1609 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.586861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89467f6f-e0e9-4f9d-8c8f-20381fbc1609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:54.587168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89467f6f-e0e9-4f9d-8c8f-20381fbc1609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.588793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89467f6f-e0e9-4f9d-8c8f-20381fbc1609 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.596512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61911c-8eda-4d7d-beda-e935ed76fc65 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.602120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33d4eb-46a1-40fc-a60d-cdd0f81bda61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.603074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33d4eb-46a1-40fc-a60d-cdd0f81bda61 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.603558 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33d4eb-46a1-40fc-a60d-cdd0f81bda61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.604012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33d4eb-46a1-40fc-a60d-cdd0f81bda61 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.604941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33d4eb-46a1-40fc-a60d-cdd0f81bda61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:54.605422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33d4eb-46a1-40fc-a60d-cdd0f81bda61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.607335 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33d4eb-46a1-40fc-a60d-cdd0f81bda61 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.609860 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 327/631] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:54.616622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467f6f-e0e9-4f9d-8c8f-20381fbc1609 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.622115 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 305/632] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:54.627857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33d4eb-46a1-40fc-a60d-cdd0f81bda61 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.633212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467f6f-e0e9-4f9d-8c8f-20381fbc1609 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.646214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe12e1d-9292-4963-9fbc-c669914660b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.647080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12e1d-9292-4963-9fbc-c669914660b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.647637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33d4eb-46a1-40fc-a60d-cdd0f81bda61 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.648501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12e1d-9292-4963-9fbc-c669914660b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.648840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe12e1d-9292-4963-9fbc-c669914660b3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.657259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe12e1d-9292-4963-9fbc-c669914660b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.657511 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc16b08-c7c1-41ba-ab59-dc24541743d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.658377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc16b08-c7c1-41ba-ab59-dc24541743d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.658658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc16b08-c7c1-41ba-ab59-dc24541743d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.659001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc16b08-c7c1-41ba-ab59-dc24541743d5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.659247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe12e1d-9292-4963-9fbc-c669914660b3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.669085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc16b08-c7c1-41ba-ab59-dc24541743d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.671220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc16b08-c7c1-41ba-ab59-dc24541743d5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.673538 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-9fe12e1d-9292-4963-9fbc-c669914660b3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:54.675035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 328/633] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:15:54.676311 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e479aa1-561f-4c84-b3e8-491a572f0723 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.676594 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e479aa1-561f-4c84-b3e8-491a572f0723 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.676870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e479aa1-561f-4c84-b3e8-491a572f0723 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.678745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 329/634] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:54.687205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-5cc16b08-c7c1-41ba-ab59-dc24541743d5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 01:15:54.687544 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e479aa1-561f-4c84-b3e8-491a572f0723 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.689140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 306/635] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:54.690599 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4604-5b5e-44f5-bb0c-29ea8256347b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.691160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4604-5b5e-44f5-bb0c-29ea8256347b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.691673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4604-5b5e-44f5-bb0c-29ea8256347b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.700843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e479aa1-561f-4c84-b3e8-491a572f0723 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.705408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32087f55-fd30-40b9-ae7c-c24f9dfebb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.706120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087f55-fd30-40b9-ae7c-c24f9dfebb60 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.706375 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087f55-fd30-40b9-ae7c-c24f9dfebb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.706753 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32087f55-fd30-40b9-ae7c-c24f9dfebb60 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.708135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32087f55-fd30-40b9-ae7c-c24f9dfebb60 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:54.708441 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32087f55-fd30-40b9-ae7c-c24f9dfebb60 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.710373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32087f55-fd30-40b9-ae7c-c24f9dfebb60 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.711758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-420f4604-5b5e-44f5-bb0c-29ea8256347b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:54.713141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-420f4604-5b5e-44f5-bb0c-29ea8256347b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:54.721373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 307/636] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:54.722420 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f4604-5b5e-44f5-bb0c-29ea8256347b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.734708 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 330/637] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:54.737789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f4604-5b5e-44f5-bb0c-29ea8256347b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.740240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32087f55-fd30-40b9-ae7c-c24f9dfebb60 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.748176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccffc9-defc-45f6-8516-49c04ab003ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.749145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccffc9-defc-45f6-8516-49c04ab003ef admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.749627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccffc9-defc-45f6-8516-49c04ab003ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.750099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccffc9-defc-45f6-8516-49c04ab003ef admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.751174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccffc9-defc-45f6-8516-49c04ab003ef admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:54.751785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccffc9-defc-45f6-8516-49c04ab003ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.754398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccffc9-defc-45f6-8516-49c04ab003ef admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.762149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32087f55-fd30-40b9-ae7c-c24f9dfebb60 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.771983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0f44f-b5b8-4529-9df2-5997324c37b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.773153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f44f-b5b8-4529-9df2-5997324c37b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.773662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f44f-b5b8-4529-9df2-5997324c37b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.774141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f44f-b5b8-4529-9df2-5997324c37b1 admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/d061cf5060334e79ab4f22518d37116f/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.776897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0f44f-b5b8-4529-9df2-5997324c37b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=d061cf5060334e79ab4f22518d37116f, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.779494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 308/638] 10.222.0.23 () {56 vars in 1171 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:54.780234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccffc9-defc-45f6-8516-49c04ab003ef admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.780871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0f44f-b5b8-4529-9df2-5997324c37b1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.794399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccffc9-defc-45f6-8516-49c04ab003ef admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.796808 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 331/639] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:54 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/d061cf5060334e79ab4f22518d37116f/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:54.804865 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0f44f-b5b8-4529-9df2-5997324c37b1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:54.905566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31843381-fd82-4937-9773-47b8c1508786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.907174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31843381-fd82-4937-9773-47b8c1508786 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.907456 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31843381-fd82-4937-9773-47b8c1508786 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.907733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31843381-fd82-4937-9773-47b8c1508786 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.908467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31843381-fd82-4937-9773-47b8c1508786 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.909483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-31843381-fd82-4937-9773-47b8c1508786 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:54.909483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:15:54.909483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:15:54.910437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31843381-fd82-4937-9773-47b8c1508786 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.930402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0f44f-b5b8-4529-9df2-5997324c37b1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:54.935541 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67b91-a16c-4a3d-aebd-74343a03fdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:54.936383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67b91-a16c-4a3d-aebd-74343a03fdeb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:54.936671 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67b91-a16c-4a3d-aebd-74343a03fdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:54.936997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67b91-a16c-4a3d-aebd-74343a03fdeb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:54.945810 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 309/640] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:15:54 2021] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:54.962713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef67b91-a16c-4a3d-aebd-74343a03fdeb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:54.964579 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef67b91-a16c-4a3d-aebd-74343a03fdeb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:54.980970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 332/641] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:54.987701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31843381-fd82-4937-9773-47b8c1508786 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:55.028496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31843381-fd82-4937-9773-47b8c1508786 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:55.033593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878a745-b1bd-47c2-9858-82a8618f30e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:55.034721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a745-b1bd-47c2-9858-82a8618f30e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:55.035291 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a745-b1bd-47c2-9858-82a8618f30e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:55.035825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a745-b1bd-47c2-9858-82a8618f30e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:55.048289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878a745-b1bd-47c2-9858-82a8618f30e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:55.050551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878a745-b1bd-47c2-9858-82a8618f30e8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:55.070278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-7878a745-b1bd-47c2-9858-82a8618f30e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:55.071951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 310/642] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:55.078365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67b91-a16c-4a3d-aebd-74343a03fdeb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:55.090841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67b91-a16c-4a3d-aebd-74343a03fdeb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:55.096998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa33d5-708b-4530-8100-f76953d882f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:55.098119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa33d5-708b-4530-8100-f76953d882f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:55.098637 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa33d5-708b-4530-8100-f76953d882f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:55.099152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa33d5-708b-4530-8100-f76953d882f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:55.100155 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa33d5-708b-4530-8100-f76953d882f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:55.100754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa33d5-708b-4530-8100-f76953d882f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:55.102798 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa33d5-708b-4530-8100-f76953d882f5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:55.118605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 333/643] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:55.124705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878a745-b1bd-47c2-9858-82a8618f30e8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:55.136059 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878a745-b1bd-47c2-9858-82a8618f30e8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:55.143834 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48775f7-7d24-4c0b-84cb-4cca393cdabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:55.145422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48775f7-7d24-4c0b-84cb-4cca393cdabf admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:55.145826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48775f7-7d24-4c0b-84cb-4cca393cdabf admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:55.146201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48775f7-7d24-4c0b-84cb-4cca393cdabf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:55.155085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48775f7-7d24-4c0b-84cb-4cca393cdabf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:55.157213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48775f7-7d24-4c0b-84cb-4cca393cdabf admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:55.172166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-e48775f7-7d24-4c0b-84cb-4cca393cdabf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:55.173872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 311/644] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:55.180569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa33d5-708b-4530-8100-f76953d882f5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:55.190882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa33d5-708b-4530-8100-f76953d882f5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:55.199144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf3f7-47e2-4a1d-955f-ef30f0647558 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:55.199604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf3f7-47e2-4a1d-955f-ef30f0647558 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:55.199781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31e666-4383-47ff-85ad-6fb60c2e0b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:55.200197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf3f7-47e2-4a1d-955f-ef30f0647558 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:55.200639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31e666-4383-47ff-85ad-6fb60c2e0b95 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:55.201016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31e666-4383-47ff-85ad-6fb60c2e0b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:55.201393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31e666-4383-47ff-85ad-6fb60c2e0b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:55.202284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31e666-4383-47ff-85ad-6fb60c2e0b95 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:55.202731 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31e666-4383-47ff-85ad-6fb60c2e0b95 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:55.202930 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 312/645] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:55.205805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31e666-4383-47ff-85ad-6fb60c2e0b95 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:55.214956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55080d44-3586-4ba7-a3c0-22727468f43b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:55.215498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55080d44-3586-4ba7-a3c0-22727468f43b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:55.215932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55080d44-3586-4ba7-a3c0-22727468f43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:55.229659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 334/646] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:55.231193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31e666-4383-47ff-85ad-6fb60c2e0b95 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:55.239634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-55080d44-3586-4ba7-a3c0-22727468f43b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:55.240959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-55080d44-3586-4ba7-a3c0-22727468f43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:55.242995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31e666-4383-47ff-85ad-6fb60c2e0b95 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:55.251136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1bed2-ce15-46de-8bd7-9f66164788b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:55.251789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1bed2-ce15-46de-8bd7-9f66164788b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:55.252072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1bed2-ce15-46de-8bd7-9f66164788b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:55.252345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1bed2-ce15-46de-8bd7-9f66164788b6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:55.253173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1bed2-ce15-46de-8bd7-9f66164788b6 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=bf5aac81feed4af7b9969937afe5a5a5) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:55.253483 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1bed2-ce15-46de-8bd7-9f66164788b6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:55.256006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1bed2-ce15-46de-8bd7-9f66164788b6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:55.256285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 313/647] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:55 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:55.263171 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 335/648] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:55 2021] GET /identity/v3/role_assignments?user.id=bf5aac81feed4af7b9969937afe5a5a5&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:55.285773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55080d44-3586-4ba7-a3c0-22727468f43b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:55.296109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55080d44-3586-4ba7-a3c0-22727468f43b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:55.302880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa613e8-b2b6-4f04-93b6-50846e2e5662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:55.303978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa613e8-b2b6-4f04-93b6-50846e2e5662 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:55.304519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa613e8-b2b6-4f04-93b6-50846e2e5662 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:55.305003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa613e8-b2b6-4f04-93b6-50846e2e5662 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:55.306020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa613e8-b2b6-4f04-93b6-50846e2e5662 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:55.307895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa613e8-b2b6-4f04-93b6-50846e2e5662 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:55.328878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 314/649] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:15:55 2021] POST /identity/v3/services => generated 240 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:15:56.001601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff7c2-db71-426d-80ae-ba5187681b8d None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.002290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff7c2-db71-426d-80ae-ba5187681b8d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.002813 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff7c2-db71-426d-80ae-ba5187681b8d None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.005072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 336/650] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:56.011417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fdc96-3f76-4d64-9be2-e62fad41e946 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.011880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fdc96-3f76-4d64-9be2-e62fad41e946 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.011959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fdc96-3f76-4d64-9be2-e62fad41e946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.036467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-e89fdc96-3f76-4d64-9be2-e62fad41e946 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:56.037656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e89fdc96-3f76-4d64-9be2-e62fad41e946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:56.053912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 315/651] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:56 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:56.099761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ff7c2-db71-426d-80ae-ba5187681b8d None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.113046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ff7c2-db71-426d-80ae-ba5187681b8d None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.117577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e6317-cfdb-4d4c-ae9b-53608659a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.118515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e6317-cfdb-4d4c-ae9b-53608659a2bb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.118991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e6317-cfdb-4d4c-ae9b-53608659a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.119555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e6317-cfdb-4d4c-ae9b-53608659a2bb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.130457 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e6317-cfdb-4d4c-ae9b-53608659a2bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:56.137498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-d26e6317-cfdb-4d4c-ae9b-53608659a2bb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:56.142773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 337/652] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:56.146803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fdc96-3f76-4d64-9be2-e62fad41e946 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.160732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fdc96-3f76-4d64-9be2-e62fad41e946 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.166823 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3fe2d-a1db-49ad-b2c5-21f1ef6727f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.167710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3fe2d-a1db-49ad-b2c5-21f1ef6727f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.168137 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3fe2d-a1db-49ad-b2c5-21f1ef6727f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.168578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3fe2d-a1db-49ad-b2c5-21f1ef6727f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.169487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3fe2d-a1db-49ad-b2c5-21f1ef6727f3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:56.169938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3fe2d-a1db-49ad-b2c5-21f1ef6727f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.171724 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3fe2d-a1db-49ad-b2c5-21f1ef6727f3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.186167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 316/653] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:56.193229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e6317-cfdb-4d4c-ae9b-53608659a2bb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.203377 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e6317-cfdb-4d4c-ae9b-53608659a2bb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.212485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d2a80-334a-4047-97f5-39e799953a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.213466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d2a80-334a-4047-97f5-39e799953a6a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.213912 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d2a80-334a-4047-97f5-39e799953a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.214189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d2a80-334a-4047-97f5-39e799953a6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.232830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d2a80-334a-4047-97f5-39e799953a6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.234710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d2a80-334a-4047-97f5-39e799953a6a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.261505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-e13d2a80-334a-4047-97f5-39e799953a6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:56.262958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 338/654] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:56.269271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3fe2d-a1db-49ad-b2c5-21f1ef6727f3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.284409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3fe2d-a1db-49ad-b2c5-21f1ef6727f3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.295214 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36824488-ea74-47e8-9581-2d70bd41fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.295881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824488-ea74-47e8-9581-2d70bd41fa21 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.296167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824488-ea74-47e8-9581-2d70bd41fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.296443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824488-ea74-47e8-9581-2d70bd41fa21 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.297173 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36824488-ea74-47e8-9581-2d70bd41fa21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:56.297481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36824488-ea74-47e8-9581-2d70bd41fa21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.299190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36824488-ea74-47e8-9581-2d70bd41fa21 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.316065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 317/655] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:56.322898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d2a80-334a-4047-97f5-39e799953a6a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.335565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d2a80-334a-4047-97f5-39e799953a6a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.343305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f7782-d8fc-476d-a518-7b582ed515f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.344102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f7782-d8fc-476d-a518-7b582ed515f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.344390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f7782-d8fc-476d-a518-7b582ed515f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.344667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f7782-d8fc-476d-a518-7b582ed515f9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.353824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f7782-d8fc-476d-a518-7b582ed515f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.355896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f7782-d8fc-476d-a518-7b582ed515f9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.372623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-345f7782-d8fc-476d-a518-7b582ed515f9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 01:15:56.373813 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 339/656] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:56.380227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36824488-ea74-47e8-9581-2d70bd41fa21 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.396669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36824488-ea74-47e8-9581-2d70bd41fa21 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.403299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaa4ea-4c74-4985-a5e6-b827aa82607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.403971 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa4ea-4c74-4985-a5e6-b827aa82607b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.404257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa4ea-4c74-4985-a5e6-b827aa82607b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.404548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa4ea-4c74-4985-a5e6-b827aa82607b admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.405373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaa4ea-4c74-4985-a5e6-b827aa82607b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:56.405680 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaa4ea-4c74-4985-a5e6-b827aa82607b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.407552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaa4ea-4c74-4985-a5e6-b827aa82607b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.429945 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 318/657] 10.222.0.23 () {56 vars in 1157 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:56.436262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f7782-d8fc-476d-a518-7b582ed515f9 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.448877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f7782-d8fc-476d-a518-7b582ed515f9 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.453479 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce51175-d338-46d8-946d-c4c886bb7ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.454114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce51175-d338-46d8-946d-c4c886bb7ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.454400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce51175-d338-46d8-946d-c4c886bb7ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.454694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce51175-d338-46d8-946d-c4c886bb7ea8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.466102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce51175-d338-46d8-946d-c4c886bb7ea8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.467843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce51175-d338-46d8-946d-c4c886bb7ea8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.479852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 340/658] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:15:56.486225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaa4ea-4c74-4985-a5e6-b827aa82607b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.499607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaa4ea-4c74-4985-a5e6-b827aa82607b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.509267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669efa9-d873-45c8-9a01-c7bce3593388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.510059 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669efa9-d873-45c8-9a01-c7bce3593388 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.510339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669efa9-d873-45c8-9a01-c7bce3593388 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.510613 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669efa9-d873-45c8-9a01-c7bce3593388 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.526271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669efa9-d873-45c8-9a01-c7bce3593388 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.528076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669efa9-d873-45c8-9a01-c7bce3593388 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.553577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-9669efa9-d873-45c8-9a01-c7bce3593388 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:56.559970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 319/659] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:56.562434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce51175-d338-46d8-946d-c4c886bb7ea8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.581170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce51175-d338-46d8-946d-c4c886bb7ea8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.596786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506602-7a73-4337-9dca-198a7ef4ab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.597462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506602-7a73-4337-9dca-198a7ef4ab83 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.598272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506602-7a73-4337-9dca-198a7ef4ab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.598551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506602-7a73-4337-9dca-198a7ef4ab83 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.599308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef506602-7a73-4337-9dca-198a7ef4ab83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:56.599613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef506602-7a73-4337-9dca-198a7ef4ab83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.601205 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef506602-7a73-4337-9dca-198a7ef4ab83 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.619902 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 341/660] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:56.626016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669efa9-d873-45c8-9a01-c7bce3593388 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.639929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669efa9-d873-45c8-9a01-c7bce3593388 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.650836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf86f6e-6587-40c2-aec5-8027f996619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.651724 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf86f6e-6587-40c2-aec5-8027f996619f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.651981 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf86f6e-6587-40c2-aec5-8027f996619f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.652255 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf86f6e-6587-40c2-aec5-8027f996619f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.667791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf86f6e-6587-40c2-aec5-8027f996619f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.669754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf86f6e-6587-40c2-aec5-8027f996619f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.690601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-ecf86f6e-6587-40c2-aec5-8027f996619f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:56.697315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 320/661] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:56.698751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506602-7a73-4337-9dca-198a7ef4ab83 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.712882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506602-7a73-4337-9dca-198a7ef4ab83 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.729899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2c0a5-3673-42ee-8563-299c8d7d457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.730579 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2c0a5-3673-42ee-8563-299c8d7d457d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.730885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2c0a5-3673-42ee-8563-299c8d7d457d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.731163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2c0a5-3673-42ee-8563-299c8d7d457d admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.731959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2c0a5-3673-42ee-8563-299c8d7d457d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:56.732270 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2c0a5-3673-42ee-8563-299c8d7d457d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.734132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2c0a5-3673-42ee-8563-299c8d7d457d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.752921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 342/662] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:56.760301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf86f6e-6587-40c2-aec5-8027f996619f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:56.777174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf86f6e-6587-40c2-aec5-8027f996619f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:56.792299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cb6f7-b35b-4377-b5ed-caa021def03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:56.792964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cb6f7-b35b-4377-b5ed-caa021def03c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:56.793246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cb6f7-b35b-4377-b5ed-caa021def03c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:56.793523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cb6f7-b35b-4377-b5ed-caa021def03c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:56.794365 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cb6f7-b35b-4377-b5ed-caa021def03c admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=861c258c3fbf470fac4af9966ac5f0c5) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:56.794693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cb6f7-b35b-4377-b5ed-caa021def03c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:56.796534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cb6f7-b35b-4377-b5ed-caa021def03c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:56.806859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 321/663] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:56 2021] GET /identity/v3/role_assignments?user.id=861c258c3fbf470fac4af9966ac5f0c5&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:57.465346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ab520-657a-4e62-b3a8-5457610a174d None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.466005 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ab520-657a-4e62-b3a8-5457610a174d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.466005 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ab520-657a-4e62-b3a8-5457610a174d None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.468020 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 343/664] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:57.474129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0767b2-a40a-4884-b8a3-d9875d6ee06b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.474636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0767b2-a40a-4884-b8a3-d9875d6ee06b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.474826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0767b2-a40a-4884-b8a3-d9875d6ee06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.502721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-3a0767b2-a40a-4884-b8a3-d9875d6ee06b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:57.504492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3a0767b2-a40a-4884-b8a3-d9875d6ee06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:57.518625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 322/665] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:57.555130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ab520-657a-4e62-b3a8-5457610a174d None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:57.572700 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ab520-657a-4e62-b3a8-5457610a174d None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:57.580955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbff62-0957-4348-b321-4cce394400cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:57.582039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbff62-0957-4348-b321-4cce394400cd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.582539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbff62-0957-4348-b321-4cce394400cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.583034 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbff62-0957-4348-b321-4cce394400cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.594487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbff62-0957-4348-b321-4cce394400cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:57.601692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-95bbff62-0957-4348-b321-4cce394400cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:57.603418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 344/666] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:57.611913 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0767b2-a40a-4884-b8a3-d9875d6ee06b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:57.626076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0767b2-a40a-4884-b8a3-d9875d6ee06b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:57.634694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc5b89-2d65-4b9d-a0fb-b7dfef74f118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:57.635370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc5b89-2d65-4b9d-a0fb-b7dfef74f118 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.635653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc5b89-2d65-4b9d-a0fb-b7dfef74f118 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.635935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc5b89-2d65-4b9d-a0fb-b7dfef74f118 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.636684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc5b89-2d65-4b9d-a0fb-b7dfef74f118 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:57.636987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc5b89-2d65-4b9d-a0fb-b7dfef74f118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:57.638864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc5b89-2d65-4b9d-a0fb-b7dfef74f118 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:57.654109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 323/667] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:57.660292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbff62-0957-4348-b321-4cce394400cd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:57.673195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbff62-0957-4348-b321-4cce394400cd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:57.681155 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4c581-1018-478c-8c81-19fea2476bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:57.682206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4c581-1018-478c-8c81-19fea2476bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.682703 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4c581-1018-478c-8c81-19fea2476bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.683210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4c581-1018-478c-8c81-19fea2476bc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.698233 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4c581-1018-478c-8c81-19fea2476bc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:57.700388 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4c581-1018-478c-8c81-19fea2476bc8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:57.723730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-f4e4c581-1018-478c-8c81-19fea2476bc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:57.725523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 345/668] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:57.731391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc5b89-2d65-4b9d-a0fb-b7dfef74f118 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:57.749076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc5b89-2d65-4b9d-a0fb-b7dfef74f118 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:57.760447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742a0ca-0464-457d-9ecc-3ba60cb62478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:57.761157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742a0ca-0464-457d-9ecc-3ba60cb62478 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.761443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742a0ca-0464-457d-9ecc-3ba60cb62478 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.761718 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742a0ca-0464-457d-9ecc-3ba60cb62478 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.762506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742a0ca-0464-457d-9ecc-3ba60cb62478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:57.762873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742a0ca-0464-457d-9ecc-3ba60cb62478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:57.764686 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742a0ca-0464-457d-9ecc-3ba60cb62478 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:57.782026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 324/669] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:57.788185 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4c581-1018-478c-8c81-19fea2476bc8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:57.804999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4c581-1018-478c-8c81-19fea2476bc8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:57.813144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c51a9-cae6-49a7-b4b1-937dcb68b68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:57.814376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c51a9-cae6-49a7-b4b1-937dcb68b68c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.814941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c51a9-cae6-49a7-b4b1-937dcb68b68c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.815435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c51a9-cae6-49a7-b4b1-937dcb68b68c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.830032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c51a9-cae6-49a7-b4b1-937dcb68b68c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:57.832604 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c51a9-cae6-49a7-b4b1-937dcb68b68c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:57.854782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-f81c51a9-cae6-49a7-b4b1-937dcb68b68c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 01:15:57.856411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 346/670] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 25 01:15:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:57.862593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742a0ca-0464-457d-9ecc-3ba60cb62478 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:57.878573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6894a01-973a-4ea9-85e7-a5137ff10d76 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.878996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6894a01-973a-4ea9-85e7-a5137ff10d76 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.879224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6894a01-973a-4ea9-85e7-a5137ff10d76 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.879936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742a0ca-0464-457d-9ecc-3ba60cb62478 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:57.882138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 347/671] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:15:57.888083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a60a2-1e28-4174-a7ad-bae0188f4ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:57.889322 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a60a2-1e28-4174-a7ad-bae0188f4ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.889799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a60a2-1e28-4174-a7ad-bae0188f4ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.890319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a60a2-1e28-4174-a7ad-bae0188f4ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.891411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a60a2-1e28-4174-a7ad-bae0188f4ab5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:57.891913 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a60a2-1e28-4174-a7ad-bae0188f4ab5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:57.894024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a60a2-1e28-4174-a7ad-bae0188f4ab5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:57.898316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c2509-b4d1-4049-94a0-2519e6b8c9c8 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.898774 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c2509-b4d1-4049-94a0-2519e6b8c9c8 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.898895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c2509-b4d1-4049-94a0-2519e6b8c9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.913665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 325/672] 10.222.0.23 () {56 vars in 1155 bytes} [Wed Aug 25 01:15:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:57.919867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a60a2-1e28-4174-a7ad-bae0188f4ab5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:57.932922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a60a2-1e28-4174-a7ad-bae0188f4ab5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:57.936694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-cb9c2509-b4d1-4049-94a0-2519e6b8c9c8 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:57.937898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cb9c2509-b4d1-4049-94a0-2519e6b8c9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:57.943793 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594c207-4651-4e59-acc2-4e7adeec3810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:57.944455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594c207-4651-4e59-acc2-4e7adeec3810 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.944738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594c207-4651-4e59-acc2-4e7adeec3810 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.945012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594c207-4651-4e59-acc2-4e7adeec3810 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.952450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 348/673] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:15:57.953826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29decf7d-e760-4a89-95c8-aad18f973ac1 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.954118 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29decf7d-e760-4a89-95c8-aad18f973ac1 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.954398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29decf7d-e760-4a89-95c8-aad18f973ac1 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.954837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594c207-4651-4e59-acc2-4e7adeec3810 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:57.956667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594c207-4651-4e59-acc2-4e7adeec3810 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:57.964387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 349/674] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:57 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:57.966136 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 326/675] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:15:57 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:15:57.973276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91135e0-37fc-420a-9649-6932edd411e1 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:57.973565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91135e0-37fc-420a-9649-6932edd411e1 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:57.973893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91135e0-37fc-420a-9649-6932edd411e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:57.983487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594c207-4651-4e59-acc2-4e7adeec3810 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:57.995787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594c207-4651-4e59-acc2-4e7adeec3810 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:57.996867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a91135e0-37fc-420a-9649-6932edd411e1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:57.998245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a91135e0-37fc-420a-9649-6932edd411e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:58.000409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb8ea7-ff8c-459c-9e82-a36b6089f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.001212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb8ea7-ff8c-459c-9e82-a36b6089f303 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.001476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb8ea7-ff8c-459c-9e82-a36b6089f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.001764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb8ea7-ff8c-459c-9e82-a36b6089f303 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.007381 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 350/676] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:58.008451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91135e0-37fc-420a-9649-6932edd411e1 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.018461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91135e0-37fc-420a-9649-6932edd411e1 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.019679 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb8ea7-ff8c-459c-9e82-a36b6089f303 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.021728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb8ea7-ff8c-459c-9e82-a36b6089f303 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.023618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e582c-cfeb-4ce8-9937-fca645fab7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.024672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e582c-cfeb-4ce8-9937-fca645fab7bc admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.025093 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e582c-cfeb-4ce8-9937-fca645fab7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.025519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e582c-cfeb-4ce8-9937-fca645fab7bc admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.026353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e582c-cfeb-4ce8-9937-fca645fab7bc admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.028183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e582c-cfeb-4ce8-9937-fca645fab7bc admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.040795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-601e582c-cfeb-4ce8-9937-fca645fab7bc admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 01:15:58.042151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 351/677] 10.222.0.23 () {56 vars in 1151 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:58.052465 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e582c-cfeb-4ce8-9937-fca645fab7bc admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.053510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-19fb8ea7-ff8c-459c-9e82-a36b6089f303 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:58.055035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 327/678] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:58.060307 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb8ea7-ff8c-459c-9e82-a36b6089f303 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.067050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e582c-cfeb-4ce8-9937-fca645fab7bc admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.071588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb8ea7-ff8c-459c-9e82-a36b6089f303 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.072111 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3d8c4-1690-4376-9a82-64c945491b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.072912 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3d8c4-1690-4376-9a82-64c945491b5f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.073358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3d8c4-1690-4376-9a82-64c945491b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.073784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3d8c4-1690-4376-9a82-64c945491b5f admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.074619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3d8c4-1690-4376-9a82-64c945491b5f admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.075084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3d8c4-1690-4376-9a82-64c945491b5f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.076678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c609ebd-c966-4b33-9d45-973dd07d3a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.076977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3d8c4-1690-4376-9a82-64c945491b5f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.077623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c609ebd-c966-4b33-9d45-973dd07d3a5d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.077976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c609ebd-c966-4b33-9d45-973dd07d3a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.078330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c609ebd-c966-4b33-9d45-973dd07d3a5d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.082255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 352/679] 10.222.0.23 () {56 vars in 1146 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:58.083262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3d8c4-1690-4376-9a82-64c945491b5f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.098151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c609ebd-c966-4b33-9d45-973dd07d3a5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:58.098587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3d8c4-1690-4376-9a82-64c945491b5f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.103158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c093d-1528-4560-ad32-6b54388c07b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.103973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c093d-1528-4560-ad32-6b54388c07b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.104394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c093d-1528-4560-ad32-6b54388c07b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.104808 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c093d-1528-4560-ad32-6b54388c07b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.105649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c093d-1528-4560-ad32-6b54388c07b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.106090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c093d-1528-4560-ad32-6b54388c07b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.106292 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-6c609ebd-c966-4b33-9d45-973dd07d3a5d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:15:58.107964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c093d-1528-4560-ad32-6b54388c07b4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.114166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 328/680] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:58.115744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c609ebd-c966-4b33-9d45-973dd07d3a5d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.124891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 353/681] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.125865 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c093d-1528-4560-ad32-6b54388c07b4 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.130094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c609ebd-c966-4b33-9d45-973dd07d3a5d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.136186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e0e1b-8254-496d-804c-8a23982dcab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.136337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c093d-1528-4560-ad32-6b54388c07b4 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.137034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e0e1b-8254-496d-804c-8a23982dcab7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.137428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e0e1b-8254-496d-804c-8a23982dcab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.137893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e0e1b-8254-496d-804c-8a23982dcab7 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.138995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e0e1b-8254-496d-804c-8a23982dcab7 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.139406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e0e1b-8254-496d-804c-8a23982dcab7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.141086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e0e1b-8254-496d-804c-8a23982dcab7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.142240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17965d0c-df87-4d67-9eba-fedab42ce13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.143122 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17965d0c-df87-4d67-9eba-fedab42ce13d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.143586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17965d0c-df87-4d67-9eba-fedab42ce13d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.143988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17965d0c-df87-4d67-9eba-fedab42ce13d admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.144999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17965d0c-df87-4d67-9eba-fedab42ce13d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.145499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17965d0c-df87-4d67-9eba-fedab42ce13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.147335 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17965d0c-df87-4d67-9eba-fedab42ce13d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.150758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 329/682] 10.222.0.23 () {56 vars in 1146 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.151803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e0e1b-8254-496d-804c-8a23982dcab7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.161652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 354/683] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.166784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e0e1b-8254-496d-804c-8a23982dcab7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.168039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17965d0c-df87-4d67-9eba-fedab42ce13d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.170272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91187c20-b628-4fbf-8a92-41758359e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.171213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91187c20-b628-4fbf-8a92-41758359e87e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.171626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91187c20-b628-4fbf-8a92-41758359e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.172024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91187c20-b628-4fbf-8a92-41758359e87e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.179944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17965d0c-df87-4d67-9eba-fedab42ce13d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.181304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91187c20-b628-4fbf-8a92-41758359e87e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.183453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91187c20-b628-4fbf-8a92-41758359e87e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.185581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47e043-1949-4ce7-84c5-d24675bcdc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.186522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47e043-1949-4ce7-84c5-d24675bcdc15 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.187045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47e043-1949-4ce7-84c5-d24675bcdc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.187460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47e043-1949-4ce7-84c5-d24675bcdc15 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.188510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47e043-1949-4ce7-84c5-d24675bcdc15 admin admin] RBAC: Adding query filter params (interface=public, service_id=a9953b3713d54859b055d9099702575b, region_id=RegionOne) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.188988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47e043-1949-4ce7-84c5-d24675bcdc15 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.190264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-8e47e043-1949-4ce7-84c5-d24675bcdc15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:15:58.190264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:15:58.190264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:15:58.191570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47e043-1949-4ce7-84c5-d24675bcdc15 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.199965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-91187c20-b628-4fbf-8a92-41758359e87e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:58.200994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 355/684] 10.222.0.23 () {56 vars in 1273 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/endpoints?service_id=a9953b3713d54859b055d9099702575b&interface=public®ion_id=RegionOne => generated 194 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.202196 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47e043-1949-4ce7-84c5-d24675bcdc15 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.207440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 330/685] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:58.208717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91187c20-b628-4fbf-8a92-41758359e87e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.217847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47e043-1949-4ce7-84c5-d24675bcdc15 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.224543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91187c20-b628-4fbf-8a92-41758359e87e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.225248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bed593-88cf-403c-a728-8ca1c7d63222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.226480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bed593-88cf-403c-a728-8ca1c7d63222 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.227062 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bed593-88cf-403c-a728-8ca1c7d63222 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.227637 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bed593-88cf-403c-a728-8ca1c7d63222 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.229271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bb30f-621d-4d3f-bd57-2d08960a5844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.230032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb30f-621d-4d3f-bd57-2d08960a5844 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.230329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb30f-621d-4d3f-bd57-2d08960a5844 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.230729 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb30f-621d-4d3f-bd57-2d08960a5844 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.231348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bb30f-621d-4d3f-bd57-2d08960a5844 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.233049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bb30f-621d-4d3f-bd57-2d08960a5844 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.244773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 331/686] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/services => generated 772 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:58.244773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bb30f-621d-4d3f-bd57-2d08960a5844 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.249872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bed593-88cf-403c-a728-8ca1c7d63222 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.251873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bed593-88cf-403c-a728-8ca1c7d63222 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.258620 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bb30f-621d-4d3f-bd57-2d08960a5844 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.273400 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b75c5a-d7dd-4fd1-831d-5154cdbc311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.274063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b75c5a-d7dd-4fd1-831d-5154cdbc311c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.274799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b75c5a-d7dd-4fd1-831d-5154cdbc311c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.275051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b75c5a-d7dd-4fd1-831d-5154cdbc311c admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.276112 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b75c5a-d7dd-4fd1-831d-5154cdbc311c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.276415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b75c5a-d7dd-4fd1-831d-5154cdbc311c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.278319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b75c5a-d7dd-4fd1-831d-5154cdbc311c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.287275 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-20bed593-88cf-403c-a728-8ca1c7d63222 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:58.288816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 356/687] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:58.290491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167033-824a-4ded-b684-da11694790a8 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.291023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167033-824a-4ded-b684-da11694790a8 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.291446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167033-824a-4ded-b684-da11694790a8 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.293461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 357/688] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:58.298583 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 332/689] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.298833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b75c5a-d7dd-4fd1-831d-5154cdbc311c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.300395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6d11-47f0-49e3-b1f2-cef619e38710 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.300893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6d11-47f0-49e3-b1f2-cef619e38710 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.301316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6d11-47f0-49e3-b1f2-cef619e38710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.309366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b75c5a-d7dd-4fd1-831d-5154cdbc311c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.314239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbb976-89d9-4837-b798-ef807a6c5249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.314988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb976-89d9-4837-b798-ef807a6c5249 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.315272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb976-89d9-4837-b798-ef807a6c5249 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.315550 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb976-89d9-4837-b798-ef807a6c5249 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.316386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbb976-89d9-4837-b798-ef807a6c5249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.316747 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbb976-89d9-4837-b798-ef807a6c5249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.318447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbb976-89d9-4837-b798-ef807a6c5249 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.327220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-be2f6d11-47f0-49e3-b1f2-cef619e38710 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:58.328670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-be2f6d11-47f0-49e3-b1f2-cef619e38710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:58.331583 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 333/690] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.337743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 358/691] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:58 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:58.342713 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbb976-89d9-4837-b798-ef807a6c5249 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.343869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f6d11-47f0-49e3-b1f2-cef619e38710 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.353019 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbb976-89d9-4837-b798-ef807a6c5249 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.360868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f6d11-47f0-49e3-b1f2-cef619e38710 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.363851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbddf3-487f-4d82-9d9c-d50a6306b94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.364556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbddf3-487f-4d82-9d9c-d50a6306b94a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.364836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbddf3-487f-4d82-9d9c-d50a6306b94a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.365157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbddf3-487f-4d82-9d9c-d50a6306b94a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.366052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbddf3-487f-4d82-9d9c-d50a6306b94a admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=d061cf5060334e79ab4f22518d37116f) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.366362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbddf3-487f-4d82-9d9c-d50a6306b94a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.368246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbddf3-487f-4d82-9d9c-d50a6306b94a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.373647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499fd22-280d-4f29-89c2-c36dc0fc56ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.374745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499fd22-280d-4f29-89c2-c36dc0fc56ae admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.375081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 334/692] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/role_assignments?user.id=d061cf5060334e79ab4f22518d37116f&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.375352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499fd22-280d-4f29-89c2-c36dc0fc56ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.375769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499fd22-280d-4f29-89c2-c36dc0fc56ae admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.376012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbddf3-487f-4d82-9d9c-d50a6306b94a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.392372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499fd22-280d-4f29-89c2-c36dc0fc56ae admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.396106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbddf3-487f-4d82-9d9c-d50a6306b94a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.399650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499fd22-280d-4f29-89c2-c36dc0fc56ae admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.405388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40492aa6-72bc-4432-88bb-712e74a8d04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.406241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40492aa6-72bc-4432-88bb-712e74a8d04f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.406526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40492aa6-72bc-4432-88bb-712e74a8d04f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.406825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40492aa6-72bc-4432-88bb-712e74a8d04f admin admin] PATH_INFO: `/v3/services/network` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.407495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40492aa6-72bc-4432-88bb-712e74a8d04f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.413112 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40492aa6-72bc-4432-88bb-712e74a8d04f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.433171 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-d499fd22-280d-4f29-89c2-c36dc0fc56ae admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 01:15:58.436924 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-40492aa6-72bc-4432-88bb-712e74a8d04f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 01:15:58.438169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 335/693] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/services/network => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:58.438618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 359/694] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:58.445881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40492aa6-72bc-4432-88bb-712e74a8d04f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.447264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499fd22-280d-4f29-89c2-c36dc0fc56ae admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.458035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40492aa6-72bc-4432-88bb-712e74a8d04f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.458251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499fd22-280d-4f29-89c2-c36dc0fc56ae admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.467011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d2a7-be79-45cc-ba31-08fde2dbc00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.467836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d2a7-be79-45cc-ba31-08fde2dbc00a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.468225 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d2a7-be79-45cc-ba31-08fde2dbc00a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.468610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d2a7-be79-45cc-ba31-08fde2dbc00a admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.468978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045e0de-5e0e-4247-a777-b6607649e0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.469831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045e0de-5e0e-4247-a777-b6607649e0dc admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.470271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045e0de-5e0e-4247-a777-b6607649e0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.470568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8d2a7-be79-45cc-ba31-08fde2dbc00a admin admin] RBAC: Adding query filter params (name=network) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.470886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045e0de-5e0e-4247-a777-b6607649e0dc admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.471098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8d2a7-be79-45cc-ba31-08fde2dbc00a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.472160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045e0de-5e0e-4247-a777-b6607649e0dc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.473181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045e0de-5e0e-4247-a777-b6607649e0dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.473735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8d2a7-be79-45cc-ba31-08fde2dbc00a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.475587 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045e0de-5e0e-4247-a777-b6607649e0dc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.479750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 360/695] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.489836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d2a7-be79-45cc-ba31-08fde2dbc00a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.496438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 336/696] 10.222.0.23 () {56 vars in 1171 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.500629 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d2a7-be79-45cc-ba31-08fde2dbc00a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.506063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94266cba-3f45-404a-b55f-77751e7c73f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.506969 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94266cba-3f45-404a-b55f-77751e7c73f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.507430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94266cba-3f45-404a-b55f-77751e7c73f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.507820 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94266cba-3f45-404a-b55f-77751e7c73f8 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.508926 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94266cba-3f45-404a-b55f-77751e7c73f8 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.509135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94266cba-3f45-404a-b55f-77751e7c73f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.510250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045e0de-5e0e-4247-a777-b6607649e0dc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.510995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94266cba-3f45-404a-b55f-77751e7c73f8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.520197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 361/697] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/services?type=network => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.524174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045e0de-5e0e-4247-a777-b6607649e0dc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.524893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94266cba-3f45-404a-b55f-77751e7c73f8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.531045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378e06-a53f-4f01-a440-c0563c9ddcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.532158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378e06-a53f-4f01-a440-c0563c9ddcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.532587 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378e06-a53f-4f01-a440-c0563c9ddcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.533699 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378e06-a53f-4f01-a440-c0563c9ddcb5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.538834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94266cba-3f45-404a-b55f-77751e7c73f8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.545385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8354ef-a257-4377-b004-538e5fb32080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.545977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8354ef-a257-4377-b004-538e5fb32080 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.546396 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8354ef-a257-4377-b004-538e5fb32080 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.546897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8354ef-a257-4377-b004-538e5fb32080 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.547781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8354ef-a257-4377-b004-538e5fb32080 admin admin] RBAC: Adding query filter params (interface=public, service_id=8787e3d10b41467384dad34d1c1f1c66, region_id=RegionOne) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.548199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8354ef-a257-4377-b004-538e5fb32080 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.548422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9378e06-a53f-4f01-a440-c0563c9ddcb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.550285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8354ef-a257-4377-b004-538e5fb32080 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.550850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9378e06-a53f-4f01-a440-c0563c9ddcb5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.556626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 362/698] 10.222.0.23 () {56 vars in 1273 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/endpoints?service_id=8787e3d10b41467384dad34d1c1f1c66&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:58.563175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8354ef-a257-4377-b004-538e5fb32080 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.571955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-c9378e06-a53f-4f01-a440-c0563c9ddcb5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:58.574645 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 337/699] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:58.577105 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8354ef-a257-4377-b004-538e5fb32080 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.583581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378e06-a53f-4f01-a440-c0563c9ddcb5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.592262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b7ade-8b8d-481b-ae2e-02e0c5d05fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.594858 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b7ade-8b8d-481b-ae2e-02e0c5d05fde admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.595209 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b7ade-8b8d-481b-ae2e-02e0c5d05fde admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.595553 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b7ade-8b8d-481b-ae2e-02e0c5d05fde admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.596487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b7ade-8b8d-481b-ae2e-02e0c5d05fde admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.596758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378e06-a53f-4f01-a440-c0563c9ddcb5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.600316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b7ade-8b8d-481b-ae2e-02e0c5d05fde admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.607406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4d2d5-6cee-452d-88cb-8d84f5a3cded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.607797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 363/700] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/services => generated 772 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:15:58.608450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4d2d5-6cee-452d-88cb-8d84f5a3cded admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.609061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4d2d5-6cee-452d-88cb-8d84f5a3cded admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.609516 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4d2d5-6cee-452d-88cb-8d84f5a3cded admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.610431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4d2d5-6cee-452d-88cb-8d84f5a3cded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.610914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4d2d5-6cee-452d-88cb-8d84f5a3cded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.612722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4d2d5-6cee-452d-88cb-8d84f5a3cded admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.630829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 338/701] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.637107 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b7ade-8b8d-481b-ae2e-02e0c5d05fde admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.648299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b7ade-8b8d-481b-ae2e-02e0c5d05fde admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.653451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603eafd-4bca-470d-ba09-322622f5c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.654304 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603eafd-4bca-470d-ba09-322622f5c305 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.654585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603eafd-4bca-470d-ba09-322622f5c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.654898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603eafd-4bca-470d-ba09-322622f5c305 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.662818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603eafd-4bca-470d-ba09-322622f5c305 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.664875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603eafd-4bca-470d-ba09-322622f5c305 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.680123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-8603eafd-4bca-470d-ba09-322622f5c305 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:58.681460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 364/702] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:58.688036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4d2d5-6cee-452d-88cb-8d84f5a3cded admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.699388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4d2d5-6cee-452d-88cb-8d84f5a3cded admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.704233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c2ad4-a55f-43b8-9021-7bf49c650223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.704904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c2ad4-a55f-43b8-9021-7bf49c650223 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.705239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c2ad4-a55f-43b8-9021-7bf49c650223 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.705520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c2ad4-a55f-43b8-9021-7bf49c650223 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.706386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c2ad4-a55f-43b8-9021-7bf49c650223 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:58.706721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c2ad4-a55f-43b8-9021-7bf49c650223 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.709241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c2ad4-a55f-43b8-9021-7bf49c650223 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.723422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 339/703] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:58.730142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603eafd-4bca-470d-ba09-322622f5c305 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:58.740560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603eafd-4bca-470d-ba09-322622f5c305 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:58.745257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db7f96-1da9-4728-b964-f6e29df4b23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:58.746218 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db7f96-1da9-4728-b964-f6e29df4b23d admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:58.746494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db7f96-1da9-4728-b964-f6e29df4b23d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:58.746843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db7f96-1da9-4728-b964-f6e29df4b23d admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/bf5aac81feed4af7b9969937afe5a5a5/roles/a7290d45b88b4a14ab8a17f724c7adf9` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:58.766894 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db7f96-1da9-4728-b964-f6e29df4b23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=bf5aac81feed4af7b9969937afe5a5a5, role_id=a7290d45b88b4a14ab8a17f724c7adf9)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:58.770301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db7f96-1da9-4728-b964-f6e29df4b23d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:58.787414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 365/704] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:15:58 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/bf5aac81feed4af7b9969937afe5a5a5/roles/a7290d45b88b4a14ab8a17f724c7adf9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:15:59.323841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea016-7899-4919-aa8d-d444e9d4bf53 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.324125 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea016-7899-4919-aa8d-d444e9d4bf53 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.324405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea016-7899-4919-aa8d-d444e9d4bf53 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.326446 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 340/705] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:15:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:15:59.332910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1c38-472a-46a9-831e-b2c32bd37f7d None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.333562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1c38-472a-46a9-831e-b2c32bd37f7d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.333995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1c38-472a-46a9-831e-b2c32bd37f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.354646 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6c6a1c38-472a-46a9-831e-b2c32bd37f7d None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:15:59.356046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6c6a1c38-472a-46a9-831e-b2c32bd37f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:15:59.442438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 366/706] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:15:59 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:15:59.478180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ea016-7899-4919-aa8d-d444e9d4bf53 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:59.491686 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ea016-7899-4919-aa8d-d444e9d4bf53 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:59.502250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03a5ef-bc17-4661-8838-44a5b8556c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:59.503665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03a5ef-bc17-4661-8838-44a5b8556c48 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.504218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03a5ef-bc17-4661-8838-44a5b8556c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.504643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03a5ef-bc17-4661-8838-44a5b8556c48 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.516079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03a5ef-bc17-4661-8838-44a5b8556c48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:15:59.523039 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-6d03a5ef-bc17-4661-8838-44a5b8556c48 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:15:59.524380 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 341/707] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:59.531160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a1c38-472a-46a9-831e-b2c32bd37f7d None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:59.543676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a1c38-472a-46a9-831e-b2c32bd37f7d None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:59.548343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e46a6d-e44d-47c2-aa4a-3c0c332e0a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:59.549171 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e46a6d-e44d-47c2-aa4a-3c0c332e0a75 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.549636 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e46a6d-e44d-47c2-aa4a-3c0c332e0a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.550058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e46a6d-e44d-47c2-aa4a-3c0c332e0a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.551528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e46a6d-e44d-47c2-aa4a-3c0c332e0a75 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:59.551981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e46a6d-e44d-47c2-aa4a-3c0c332e0a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:59.553746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e46a6d-e44d-47c2-aa4a-3c0c332e0a75 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:59.566042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 367/708] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:15:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:59.572312 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03a5ef-bc17-4661-8838-44a5b8556c48 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:59.582331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03a5ef-bc17-4661-8838-44a5b8556c48 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:59.590189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07875d-8765-4153-a44f-8381cb5534f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:59.591168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07875d-8765-4153-a44f-8381cb5534f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.591622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07875d-8765-4153-a44f-8381cb5534f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.592042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07875d-8765-4153-a44f-8381cb5534f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.603732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07875d-8765-4153-a44f-8381cb5534f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:59.605730 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07875d-8765-4153-a44f-8381cb5534f6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:59.622425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-4d07875d-8765-4153-a44f-8381cb5534f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:59.624121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 342/709] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:59.630030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e46a6d-e44d-47c2-aa4a-3c0c332e0a75 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:59.642872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e46a6d-e44d-47c2-aa4a-3c0c332e0a75 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:59.648048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234e55-7e11-4001-8c59-0f8f0a47af1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:59.648878 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234e55-7e11-4001-8c59-0f8f0a47af1c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.649408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234e55-7e11-4001-8c59-0f8f0a47af1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.649835 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234e55-7e11-4001-8c59-0f8f0a47af1c admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.650718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234e55-7e11-4001-8c59-0f8f0a47af1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:59.651174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234e55-7e11-4001-8c59-0f8f0a47af1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:59.652915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234e55-7e11-4001-8c59-0f8f0a47af1c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:59.670258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 368/710] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:59.677173 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07875d-8765-4153-a44f-8381cb5534f6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:59.688045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07875d-8765-4153-a44f-8381cb5534f6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:59.698848 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406967be-e96c-4121-b928-e23274dfe084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:59.699839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406967be-e96c-4121-b928-e23274dfe084 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.700293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406967be-e96c-4121-b928-e23274dfe084 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.700730 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406967be-e96c-4121-b928-e23274dfe084 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.711088 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406967be-e96c-4121-b928-e23274dfe084 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:59.713408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406967be-e96c-4121-b928-e23274dfe084 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:59.728027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-406967be-e96c-4121-b928-e23274dfe084 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 01:15:59.729785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 343/711] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:15:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:59.735892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234e55-7e11-4001-8c59-0f8f0a47af1c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:59.747613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234e55-7e11-4001-8c59-0f8f0a47af1c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:59.752308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ec29-7d1f-43eb-9998-bfdea1d5b3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:59.753189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ec29-7d1f-43eb-9998-bfdea1d5b3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.753708 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ec29-7d1f-43eb-9998-bfdea1d5b3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.754286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ec29-7d1f-43eb-9998-bfdea1d5b3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.759423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ec29-7d1f-43eb-9998-bfdea1d5b3f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:59.759935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ec29-7d1f-43eb-9998-bfdea1d5b3f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:59.761975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ec29-7d1f-43eb-9998-bfdea1d5b3f7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:59.786326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 369/712] 10.222.0.23 () {56 vars in 1157 bytes} [Wed Aug 25 01:15:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:59.792416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406967be-e96c-4121-b928-e23274dfe084 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:59.802441 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406967be-e96c-4121-b928-e23274dfe084 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:59.810222 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae19ee-aae8-4426-b83f-4ba29736fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:59.811242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae19ee-aae8-4426-b83f-4ba29736fe31 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.811727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae19ee-aae8-4426-b83f-4ba29736fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.812178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae19ee-aae8-4426-b83f-4ba29736fe31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.827451 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae19ee-aae8-4426-b83f-4ba29736fe31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:59.829487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae19ee-aae8-4426-b83f-4ba29736fe31 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:59.846767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-4dae19ee-aae8-4426-b83f-4ba29736fe31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:15:59.849298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 344/713] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:15:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:59.855301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ec29-7d1f-43eb-9998-bfdea1d5b3f7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:59.866416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ec29-7d1f-43eb-9998-bfdea1d5b3f7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:59.871296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413e093-e9cc-47ca-8bd7-9b484c994967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:59.872168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e093-e9cc-47ca-8bd7-9b484c994967 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.872724 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e093-e9cc-47ca-8bd7-9b484c994967 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.873186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e093-e9cc-47ca-8bd7-9b484c994967 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.874086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413e093-e9cc-47ca-8bd7-9b484c994967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:59.874566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413e093-e9cc-47ca-8bd7-9b484c994967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:59.876362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413e093-e9cc-47ca-8bd7-9b484c994967 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:59.893890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 370/714] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:15:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:15:59.900121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae19ee-aae8-4426-b83f-4ba29736fe31 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:59.910177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae19ee-aae8-4426-b83f-4ba29736fe31 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:59.918271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a944076-7960-41e3-b1f5-1c6042c5d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:59.919303 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944076-7960-41e3-b1f5-1c6042c5d551 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.919795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944076-7960-41e3-b1f5-1c6042c5d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.920254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944076-7960-41e3-b1f5-1c6042c5d551 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.928429 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a944076-7960-41e3-b1f5-1c6042c5d551 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:59.930605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a944076-7960-41e3-b1f5-1c6042c5d551 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:15:59.949383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-5a944076-7960-41e3-b1f5-1c6042c5d551 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:15:59.955221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 345/715] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:15:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:15:59.961320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413e093-e9cc-47ca-8bd7-9b484c994967 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:15:59.975817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413e093-e9cc-47ca-8bd7-9b484c994967 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:15:59.980560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd1342-558f-4095-9856-035c9121b814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:15:59.981414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd1342-558f-4095-9856-035c9121b814 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:15:59.981908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd1342-558f-4095-9856-035c9121b814 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:15:59.982357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd1342-558f-4095-9856-035c9121b814 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:15:59.983342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd1342-558f-4095-9856-035c9121b814 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:15:59.983846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd1342-558f-4095-9856-035c9121b814 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:15:59.985861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd1342-558f-4095-9856-035c9121b814 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:00.005709 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 371/716] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:15:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:00.011812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a944076-7960-41e3-b1f5-1c6042c5d551 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:00.022049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a944076-7960-41e3-b1f5-1c6042c5d551 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:00.030245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7d0ba-edaa-4efb-b230-5ed66647f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:00.031373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d0ba-edaa-4efb-b230-5ed66647f6de admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:00.031860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d0ba-edaa-4efb-b230-5ed66647f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:00.032315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7d0ba-edaa-4efb-b230-5ed66647f6de admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/861c258c3fbf470fac4af9966ac5f0c5/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:00.034474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7d0ba-edaa-4efb-b230-5ed66647f6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=861c258c3fbf470fac4af9966ac5f0c5, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:00.037352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7d0ba-edaa-4efb-b230-5ed66647f6de admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:00.058516 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 346/717] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:16:00 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/861c258c3fbf470fac4af9966ac5f0c5/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:16:01.046482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e94884-810f-406c-a2da-bb9243300efb None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.047499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e94884-810f-406c-a2da-bb9243300efb None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.048013 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e94884-810f-406c-a2da-bb9243300efb None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.050227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 372/718] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:01.056566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6452f1-df8f-4e7e-a579-24257ea77c1b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.056990 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6452f1-df8f-4e7e-a579-24257ea77c1b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.057168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6452f1-df8f-4e7e-a579-24257ea77c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.083625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-1f6452f1-df8f-4e7e-a579-24257ea77c1b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:01.084826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1f6452f1-df8f-4e7e-a579-24257ea77c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:01.163242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 347/719] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:01 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:01.200214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e94884-810f-406c-a2da-bb9243300efb None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.220267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e94884-810f-406c-a2da-bb9243300efb None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.223337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2717b26-4244-4522-996b-9831c8520ff5 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.223625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2717b26-4244-4522-996b-9831c8520ff5 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.223906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2717b26-4244-4522-996b-9831c8520ff5 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.225899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 348/720] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:01.229208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7797f-0952-406b-ac2d-698891e3b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.230004 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7797f-0952-406b-ac2d-698891e3b756 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.230439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7797f-0952-406b-ac2d-698891e3b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.230554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7797f-0952-406b-ac2d-698891e3b756 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.231215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7797f-0952-406b-ac2d-698891e3b756 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.231611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6573dc5-1c52-417b-8e46-b932904237be None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.231906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6573dc5-1c52-417b-8e46-b932904237be None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.232185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6573dc5-1c52-417b-8e46-b932904237be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.232813 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7797f-0952-406b-ac2d-698891e3b756 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.250137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-41c7797f-0952-406b-ac2d-698891e3b756 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 01:16:01.251653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 373/721] 10.222.0.23 () {56 vars in 1151 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:01.256600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-f6573dc5-1c52-417b-8e46-b932904237be None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:01.258024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f6573dc5-1c52-417b-8e46-b932904237be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:01.271068 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 349/722] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:01 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:01.271239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7797f-0952-406b-ac2d-698891e3b756 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.283626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7797f-0952-406b-ac2d-698891e3b756 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.290771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba32e2-61f1-484f-90c4-a3cff73620d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.291436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba32e2-61f1-484f-90c4-a3cff73620d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.291715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba32e2-61f1-484f-90c4-a3cff73620d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.291991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba32e2-61f1-484f-90c4-a3cff73620d0 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.292696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba32e2-61f1-484f-90c4-a3cff73620d0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:01.293000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba32e2-61f1-484f-90c4-a3cff73620d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.294578 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba32e2-61f1-484f-90c4-a3cff73620d0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.295569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6573dc5-1c52-417b-8e46-b932904237be None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.305292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 374/723] 10.222.0.23 () {56 vars in 1146 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:01.305602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6573dc5-1c52-417b-8e46-b932904237be None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.310141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b1e8d-8bfc-438b-af67-4d90639298dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.310961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b1e8d-8bfc-438b-af67-4d90639298dd admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.311242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b1e8d-8bfc-438b-af67-4d90639298dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.311516 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b1e8d-8bfc-438b-af67-4d90639298dd admin admin] PATH_INFO: `/v3/services/network` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.312182 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b1e8d-8bfc-438b-af67-4d90639298dd admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.313069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba32e2-61f1-484f-90c4-a3cff73620d0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.313855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b1e8d-8bfc-438b-af67-4d90639298dd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.326287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-055b1e8d-8bfc-438b-af67-4d90639298dd admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 01:16:01.327891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 350/724] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/services/network => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:01.334114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b1e8d-8bfc-438b-af67-4d90639298dd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.335416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba32e2-61f1-484f-90c4-a3cff73620d0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.343920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b1e8d-8bfc-438b-af67-4d90639298dd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.349025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d49e-2b9d-49f1-ae50-8da2661e4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.349761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d49e-2b9d-49f1-ae50-8da2661e4977 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.350044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d49e-2b9d-49f1-ae50-8da2661e4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.350316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d49e-2b9d-49f1-ae50-8da2661e4977 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.351132 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523d49e-2b9d-49f1-ae50-8da2661e4977 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:01.351416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fcd4c-90b3-4379-b268-8945c9fe9122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.351537 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523d49e-2b9d-49f1-ae50-8da2661e4977 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.352096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fcd4c-90b3-4379-b268-8945c9fe9122 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.352375 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fcd4c-90b3-4379-b268-8945c9fe9122 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.352647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fcd4c-90b3-4379-b268-8945c9fe9122 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.353189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523d49e-2b9d-49f1-ae50-8da2661e4977 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.353373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fcd4c-90b3-4379-b268-8945c9fe9122 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:01.353647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fcd4c-90b3-4379-b268-8945c9fe9122 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.355892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fcd4c-90b3-4379-b268-8945c9fe9122 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.358837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 351/725] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/services?name=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:01.366263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d49e-2b9d-49f1-ae50-8da2661e4977 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.372928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 375/726] 10.222.0.23 () {56 vars in 1146 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:01.379796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fcd4c-90b3-4379-b268-8945c9fe9122 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.382756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d49e-2b9d-49f1-ae50-8da2661e4977 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.388543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7b751-8965-4f25-81cb-1c7d74d1e31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.389701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7b751-8965-4f25-81cb-1c7d74d1e31c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.390230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7b751-8965-4f25-81cb-1c7d74d1e31c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.390732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7b751-8965-4f25-81cb-1c7d74d1e31c admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.391720 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7b751-8965-4f25-81cb-1c7d74d1e31c admin admin] RBAC: Adding query filter params (type=network) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:01.392909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7b751-8965-4f25-81cb-1c7d74d1e31c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.395097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7b751-8965-4f25-81cb-1c7d74d1e31c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.400819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 352/727] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/services?type=network => generated 350 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:01.406079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fcd4c-90b3-4379-b268-8945c9fe9122 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.407185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7b751-8965-4f25-81cb-1c7d74d1e31c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.417598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7b751-8965-4f25-81cb-1c7d74d1e31c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.420143 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a336b7-356a-4e29-9149-1327d91979c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.420824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a336b7-356a-4e29-9149-1327d91979c3 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.421108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a336b7-356a-4e29-9149-1327d91979c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.421380 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a336b7-356a-4e29-9149-1327d91979c3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.422125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a336b7-356a-4e29-9149-1327d91979c3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.423159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-d0a336b7-356a-4e29-9149-1327d91979c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:16:01.423159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:16:01.423159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:16:01.424047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a336b7-356a-4e29-9149-1327d91979c3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.424435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116dc9f-625d-4497-8331-7dd317f13cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.425399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116dc9f-625d-4497-8331-7dd317f13cda admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.426429 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116dc9f-625d-4497-8331-7dd317f13cda admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.426921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116dc9f-625d-4497-8331-7dd317f13cda admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.427932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116dc9f-625d-4497-8331-7dd317f13cda admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.429162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-a116dc9f-625d-4497-8331-7dd317f13cda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:16:01.429162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:16:01.429162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:16:01.430436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116dc9f-625d-4497-8331-7dd317f13cda admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.459659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 353/728] 10.222.0.23 () {60 vars in 1166 bytes} [Wed Aug 25 01:16:01 2021] POST /identity/v3/endpoints => generated 327 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:01.466704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf6723-603a-4c71-b51e-8a3e8a0c1338 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.466704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf6723-603a-4c71-b51e-8a3e8a0c1338 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.466704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf6723-603a-4c71-b51e-8a3e8a0c1338 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.466704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 354/729] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:01.467975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 376/730] 10.222.0.23 () {60 vars in 1166 bytes} [Wed Aug 25 01:16:01 2021] POST /identity/v3/endpoints => generated 346 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:16:01.470483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54003b54-2d50-45e7-852b-da1abc597198 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.470886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54003b54-2d50-45e7-852b-da1abc597198 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.471222 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54003b54-2d50-45e7-852b-da1abc597198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.498892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-54003b54-2d50-45e7-852b-da1abc597198 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:01.500224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-54003b54-2d50-45e7-852b-da1abc597198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:01.527018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 355/731] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:01 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:01.551760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a336b7-356a-4e29-9149-1327d91979c3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.569703 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a336b7-356a-4e29-9149-1327d91979c3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.579453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeb72c-1237-455d-867f-80526b6e918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.580298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeb72c-1237-455d-867f-80526b6e918e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.580580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeb72c-1237-455d-867f-80526b6e918e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.580858 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeb72c-1237-455d-867f-80526b6e918e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.581523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedeb72c-1237-455d-867f-80526b6e918e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.583290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedeb72c-1237-455d-867f-80526b6e918e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.599555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-cedeb72c-1237-455d-867f-80526b6e918e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 01:16:01.606561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 377/732] 10.222.0.23 () {56 vars in 1154 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:01.607908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54003b54-2d50-45e7-852b-da1abc597198 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.610596 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665386e3-360e-4b31-b1c9-af5f6305871f None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.610925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665386e3-360e-4b31-b1c9-af5f6305871f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.611210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665386e3-360e-4b31-b1c9-af5f6305871f None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.613735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 378/733] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:01.618270 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54003b54-2d50-45e7-852b-da1abc597198 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.623801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb994647-9b6d-4156-82ea-c3bd885006ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.624487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb994647-9b6d-4156-82ea-c3bd885006ec admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.624773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb994647-9b6d-4156-82ea-c3bd885006ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.624934 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc944-4b46-49ee-a5ee-4b8e065ec13f None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.625083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb994647-9b6d-4156-82ea-c3bd885006ec admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.625242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc944-4b46-49ee-a5ee-4b8e065ec13f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.625419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc944-4b46-49ee-a5ee-4b8e065ec13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.625842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb994647-9b6d-4156-82ea-c3bd885006ec admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:01.626152 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb994647-9b6d-4156-82ea-c3bd885006ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.627848 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb994647-9b6d-4156-82ea-c3bd885006ec admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.633728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 356/734] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:01.641960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb994647-9b6d-4156-82ea-c3bd885006ec admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.653541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb994647-9b6d-4156-82ea-c3bd885006ec admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.658700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811027d-4341-42c9-bf04-7198ce6f032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.659452 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811027d-4341-42c9-bf04-7198ce6f032c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.659741 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811027d-4341-42c9-bf04-7198ce6f032c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.659901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2b2cc944-4b46-49ee-a5ee-4b8e065ec13f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:01.660588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811027d-4341-42c9-bf04-7198ce6f032c admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.661278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811027d-4341-42c9-bf04-7198ce6f032c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:01.661578 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2b2cc944-4b46-49ee-a5ee-4b8e065ec13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:01.661744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811027d-4341-42c9-bf04-7198ce6f032c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.663373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811027d-4341-42c9-bf04-7198ce6f032c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.669238 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 357/735] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:01.680400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 379/736] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:01 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 25 01:16:01.723124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811027d-4341-42c9-bf04-7198ce6f032c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.733908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811027d-4341-42c9-bf04-7198ce6f032c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.739858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144dae6-2435-4719-9675-0a39a012331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.740754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144dae6-2435-4719-9675-0a39a012331d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.741044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144dae6-2435-4719-9675-0a39a012331d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.741326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144dae6-2435-4719-9675-0a39a012331d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.754940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144dae6-2435-4719-9675-0a39a012331d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:01.762957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-c144dae6-2435-4719-9675-0a39a012331d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:16:01.764875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 358/737] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:01.771547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc944-4b46-49ee-a5ee-4b8e065ec13f None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.784874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc944-4b46-49ee-a5ee-4b8e065ec13f None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.792510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3dc39-5eb4-42ef-a738-930ea7e729b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.793201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3dc39-5eb4-42ef-a738-930ea7e729b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.793486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3dc39-5eb4-42ef-a738-930ea7e729b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.793769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3dc39-5eb4-42ef-a738-930ea7e729b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.794534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3dc39-5eb4-42ef-a738-930ea7e729b3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:01.794938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3dc39-5eb4-42ef-a738-930ea7e729b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.796564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3dc39-5eb4-42ef-a738-930ea7e729b3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.810867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 380/738] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:01.813064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144dae6-2435-4719-9675-0a39a012331d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.825036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144dae6-2435-4719-9675-0a39a012331d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.831608 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb81c5-4a7c-4447-be33-7b23e31594bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.832459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb81c5-4a7c-4447-be33-7b23e31594bd admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.832739 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb81c5-4a7c-4447-be33-7b23e31594bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.833013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb81c5-4a7c-4447-be33-7b23e31594bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.844932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb81c5-4a7c-4447-be33-7b23e31594bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.846814 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb81c5-4a7c-4447-be33-7b23e31594bd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.867733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-81cb81c5-4a7c-4447-be33-7b23e31594bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:01.870755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 359/739] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:01.875546 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3dc39-5eb4-42ef-a738-930ea7e729b3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.886295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3dc39-5eb4-42ef-a738-930ea7e729b3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.894801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104cf97-5edf-4a6c-891e-e84ea2a662a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.894801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cf97-5edf-4a6c-891e-e84ea2a662a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.894801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cf97-5edf-4a6c-891e-e84ea2a662a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.894801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cf97-5edf-4a6c-891e-e84ea2a662a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.895147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104cf97-5edf-4a6c-891e-e84ea2a662a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:01.895147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104cf97-5edf-4a6c-891e-e84ea2a662a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.895440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104cf97-5edf-4a6c-891e-e84ea2a662a7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.907644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 381/740] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:01.915760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb81c5-4a7c-4447-be33-7b23e31594bd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.926358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb81c5-4a7c-4447-be33-7b23e31594bd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.931079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa571ec5-4d59-4480-a000-cefdd305da1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.931931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa571ec5-4d59-4480-a000-cefdd305da1d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.932215 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa571ec5-4d59-4480-a000-cefdd305da1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.932492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa571ec5-4d59-4480-a000-cefdd305da1d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.940173 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa571ec5-4d59-4480-a000-cefdd305da1d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.942209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa571ec5-4d59-4480-a000-cefdd305da1d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:01.956417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-fa571ec5-4d59-4480-a000-cefdd305da1d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 01:16:01.962212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 360/741] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:01.964728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104cf97-5edf-4a6c-891e-e84ea2a662a7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:01.975308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104cf97-5edf-4a6c-891e-e84ea2a662a7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:01.980003 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dcefb-5247-47a8-b390-71e41b3218dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:01.980718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dcefb-5247-47a8-b390-71e41b3218dd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:01.981001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dcefb-5247-47a8-b390-71e41b3218dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:01.981275 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dcefb-5247-47a8-b390-71e41b3218dd admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:01.982164 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57dcefb-5247-47a8-b390-71e41b3218dd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:01.982476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57dcefb-5247-47a8-b390-71e41b3218dd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:01.984404 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57dcefb-5247-47a8-b390-71e41b3218dd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.002237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 382/742] 10.222.0.23 () {56 vars in 1171 bytes} [Wed Aug 25 01:16:01 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:02.008669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa571ec5-4d59-4480-a000-cefdd305da1d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.018992 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa571ec5-4d59-4480-a000-cefdd305da1d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.024284 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0e6e1-2913-447b-a342-ac9d6aa278cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.024920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0e6e1-2913-447b-a342-ac9d6aa278cf admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.025263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0e6e1-2913-447b-a342-ac9d6aa278cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.025542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0e6e1-2913-447b-a342-ac9d6aa278cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.033693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0e6e1-2913-447b-a342-ac9d6aa278cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:02.036184 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0e6e1-2913-447b-a342-ac9d6aa278cf admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.050479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 361/743] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:02.051929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dcefb-5247-47a8-b390-71e41b3218dd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.061731 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dcefb-5247-47a8-b390-71e41b3218dd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.066530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522cdc5-c02c-46fd-9175-793d468839f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.067447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522cdc5-c02c-46fd-9175-793d468839f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.067728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522cdc5-c02c-46fd-9175-793d468839f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.068002 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522cdc5-c02c-46fd-9175-793d468839f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.078819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522cdc5-c02c-46fd-9175-793d468839f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:02.080594 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522cdc5-c02c-46fd-9175-793d468839f7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.098632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-e522cdc5-c02c-46fd-9175-793d468839f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:02.102788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 383/744] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:02.106370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0e6e1-2913-447b-a342-ac9d6aa278cf admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.115337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0e6e1-2913-447b-a342-ac9d6aa278cf admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.120019 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3b01-5f10-48b1-9ae0-f6eea8b3ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.120757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3b01-5f10-48b1-9ae0-f6eea8b3ec22 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.121106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3b01-5f10-48b1-9ae0-f6eea8b3ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.121388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3b01-5f10-48b1-9ae0-f6eea8b3ec22 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.122108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3b01-5f10-48b1-9ae0-f6eea8b3ec22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:02.122414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3b01-5f10-48b1-9ae0-f6eea8b3ec22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:02.124062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3b01-5f10-48b1-9ae0-f6eea8b3ec22 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.140097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 362/745] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:02.146789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522cdc5-c02c-46fd-9175-793d468839f7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.156564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522cdc5-c02c-46fd-9175-793d468839f7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.161741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2c2a1-99e0-47fd-966e-1d7534b4cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.162522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2c2a1-99e0-47fd-966e-1d7534b4cc4d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.162834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2c2a1-99e0-47fd-966e-1d7534b4cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.163114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2c2a1-99e0-47fd-966e-1d7534b4cc4d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.169892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2c2a1-99e0-47fd-966e-1d7534b4cc4d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:02.171949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2c2a1-99e0-47fd-966e-1d7534b4cc4d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.184824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-8fb2c2a1-99e0-47fd-966e-1d7534b4cc4d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:16:02.190804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 384/746] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:02.192474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3b01-5f10-48b1-9ae0-f6eea8b3ec22 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.202099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3b01-5f10-48b1-9ae0-f6eea8b3ec22 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.207329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810af5b-e4e1-465a-9920-f4c10fd2dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.208001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810af5b-e4e1-465a-9920-f4c10fd2dcee admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.208271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810af5b-e4e1-465a-9920-f4c10fd2dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.208602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810af5b-e4e1-465a-9920-f4c10fd2dcee admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.209385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810af5b-e4e1-465a-9920-f4c10fd2dcee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:02.209745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810af5b-e4e1-465a-9920-f4c10fd2dcee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:02.211670 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810af5b-e4e1-465a-9920-f4c10fd2dcee admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.224595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 363/747] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:02.231194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2c2a1-99e0-47fd-966e-1d7534b4cc4d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.241856 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2c2a1-99e0-47fd-966e-1d7534b4cc4d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.246520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9a3aa-1bc3-4d20-8e49-643917856f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.247231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9a3aa-1bc3-4d20-8e49-643917856f51 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.247513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9a3aa-1bc3-4d20-8e49-643917856f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.247846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9a3aa-1bc3-4d20-8e49-643917856f51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.248665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9a3aa-1bc3-4d20-8e49-643917856f51 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=bf5aac81feed4af7b9969937afe5a5a5) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:02.249027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9a3aa-1bc3-4d20-8e49-643917856f51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:02.251033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9a3aa-1bc3-4d20-8e49-643917856f51 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.262798 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 385/748] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/role_assignments?user.id=bf5aac81feed4af7b9969937afe5a5a5&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:02.695258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f905-932f-40b0-942d-96b7b2611649 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.695653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f905-932f-40b0-942d-96b7b2611649 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.695842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f905-932f-40b0-942d-96b7b2611649 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.697801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 364/749] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:02.703948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c786cd-96a9-4a89-9650-8740a005567b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.704246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c786cd-96a9-4a89-9650-8740a005567b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.704532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c786cd-96a9-4a89-9650-8740a005567b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.723470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-56c786cd-96a9-4a89-9650-8740a005567b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:02.724678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-56c786cd-96a9-4a89-9650-8740a005567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:02.732678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 386/750] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:02 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:02.757392 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3f905-932f-40b0-942d-96b7b2611649 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.770998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3f905-932f-40b0-942d-96b7b2611649 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.775676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ee71-fc9a-43cd-a684-6ae815dd9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.776685 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ee71-fc9a-43cd-a684-6ae815dd9a5b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.777180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ee71-fc9a-43cd-a684-6ae815dd9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.777658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ee71-fc9a-43cd-a684-6ae815dd9a5b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.788592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232ee71-fc9a-43cd-a684-6ae815dd9a5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:02.795695 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-1232ee71-fc9a-43cd-a684-6ae815dd9a5b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:16:02.797464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 365/751] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:02.804819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c786cd-96a9-4a89-9650-8740a005567b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.814144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c786cd-96a9-4a89-9650-8740a005567b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.819650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d68d1-40b7-4a1a-995d-bec885aa67ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.820536 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d68d1-40b7-4a1a-995d-bec885aa67ff admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.821018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d68d1-40b7-4a1a-995d-bec885aa67ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.821518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d68d1-40b7-4a1a-995d-bec885aa67ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.822458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d68d1-40b7-4a1a-995d-bec885aa67ff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:02.823031 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d68d1-40b7-4a1a-995d-bec885aa67ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:02.824816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d68d1-40b7-4a1a-995d-bec885aa67ff admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.833997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 387/752] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:02.840873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ee71-fc9a-43cd-a684-6ae815dd9a5b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.851547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ee71-fc9a-43cd-a684-6ae815dd9a5b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.856502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ae0e3-1108-4aee-a21d-75911b22bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.857552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ae0e3-1108-4aee-a21d-75911b22bb8d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.858107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ae0e3-1108-4aee-a21d-75911b22bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.858592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ae0e3-1108-4aee-a21d-75911b22bb8d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.870348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ae0e3-1108-4aee-a21d-75911b22bb8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:02.872572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ae0e3-1108-4aee-a21d-75911b22bb8d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.890057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-690ae0e3-1108-4aee-a21d-75911b22bb8d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:02.892056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 366/753] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:02.898780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d68d1-40b7-4a1a-995d-bec885aa67ff admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.909108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d68d1-40b7-4a1a-995d-bec885aa67ff admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.914013 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9881f0-4a4f-4b59-9767-ea8190d38ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.914975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9881f0-4a4f-4b59-9767-ea8190d38ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.915551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9881f0-4a4f-4b59-9767-ea8190d38ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.916038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9881f0-4a4f-4b59-9767-ea8190d38ab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.916964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9881f0-4a4f-4b59-9767-ea8190d38ab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:02.917482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9881f0-4a4f-4b59-9767-ea8190d38ab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:02.919338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9881f0-4a4f-4b59-9767-ea8190d38ab3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.935301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 388/754] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:02.942146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ae0e3-1108-4aee-a21d-75911b22bb8d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:02.952881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ae0e3-1108-4aee-a21d-75911b22bb8d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:02.958246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d3b45-6e3e-4613-900a-fadbd85a0a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:02.959408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d3b45-6e3e-4613-900a-fadbd85a0a2a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:02.959896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d3b45-6e3e-4613-900a-fadbd85a0a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:02.960367 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d3b45-6e3e-4613-900a-fadbd85a0a2a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:02.970266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d3b45-6e3e-4613-900a-fadbd85a0a2a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:02.972672 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d3b45-6e3e-4613-900a-fadbd85a0a2a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:02.986283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-911d3b45-6e3e-4613-900a-fadbd85a0a2a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 01:16:02.988539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 367/755] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:02.995036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9881f0-4a4f-4b59-9767-ea8190d38ab3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:03.005819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9881f0-4a4f-4b59-9767-ea8190d38ab3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:03.010766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719e5db-c2d6-431e-aac3-b7c27c97f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:03.011698 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719e5db-c2d6-431e-aac3-b7c27c97f475 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.012232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719e5db-c2d6-431e-aac3-b7c27c97f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.012707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719e5db-c2d6-431e-aac3-b7c27c97f475 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.014055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719e5db-c2d6-431e-aac3-b7c27c97f475 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:03.014622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719e5db-c2d6-431e-aac3-b7c27c97f475 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:03.016768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719e5db-c2d6-431e-aac3-b7c27c97f475 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:03.035670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 389/756] 10.222.0.23 () {56 vars in 1157 bytes} [Wed Aug 25 01:16:02 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:03.041816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d3b45-6e3e-4613-900a-fadbd85a0a2a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:03.052358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d3b45-6e3e-4613-900a-fadbd85a0a2a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:03.057200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3f1db-e27a-4660-b93d-9cd1353c4e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:03.058077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3f1db-e27a-4660-b93d-9cd1353c4e1f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.058562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3f1db-e27a-4660-b93d-9cd1353c4e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.059076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3f1db-e27a-4660-b93d-9cd1353c4e1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.067734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3f1db-e27a-4660-b93d-9cd1353c4e1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:03.069730 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3f1db-e27a-4660-b93d-9cd1353c4e1f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:03.079134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 368/757] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:03 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:03.085589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719e5db-c2d6-431e-aac3-b7c27c97f475 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:03.096058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719e5db-c2d6-431e-aac3-b7c27c97f475 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:03.101636 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b1bc3-db0e-436b-bb03-0364c3312ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:03.102761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b1bc3-db0e-436b-bb03-0364c3312ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.103247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b1bc3-db0e-436b-bb03-0364c3312ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.103762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b1bc3-db0e-436b-bb03-0364c3312ba7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.114757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b1bc3-db0e-436b-bb03-0364c3312ba7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:03.116829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b1bc3-db0e-436b-bb03-0364c3312ba7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:03.133647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-2a6b1bc3-db0e-436b-bb03-0364c3312ba7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:03.135092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 390/758] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:03.141716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3f1db-e27a-4660-b93d-9cd1353c4e1f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:03.151289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3f1db-e27a-4660-b93d-9cd1353c4e1f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:03.156053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288ea13-d306-48c7-9b40-9431d542b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:03.156981 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288ea13-d306-48c7-9b40-9431d542b322 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.157464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288ea13-d306-48c7-9b40-9431d542b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.157978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288ea13-d306-48c7-9b40-9431d542b322 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.158931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288ea13-d306-48c7-9b40-9431d542b322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:03.159485 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288ea13-d306-48c7-9b40-9431d542b322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:03.161890 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288ea13-d306-48c7-9b40-9431d542b322 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:03.174976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 369/759] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:03.182210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b1bc3-db0e-436b-bb03-0364c3312ba7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:03.193024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b1bc3-db0e-436b-bb03-0364c3312ba7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:03.198234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686d605-b936-4982-89c3-5f9656e5c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:03.199455 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686d605-b936-4982-89c3-5f9656e5c581 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.199960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686d605-b936-4982-89c3-5f9656e5c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.200434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686d605-b936-4982-89c3-5f9656e5c581 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.209081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686d605-b936-4982-89c3-5f9656e5c581 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:03.211482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686d605-b936-4982-89c3-5f9656e5c581 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:03.225690 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-1686d605-b936-4982-89c3-5f9656e5c581 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:16:03.227454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 391/760] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:03.233977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288ea13-d306-48c7-9b40-9431d542b322 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:03.244100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288ea13-d306-48c7-9b40-9431d542b322 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:03.249035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df256c6b-202d-40e4-8ab8-2c40d0a41850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:03.249944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df256c6b-202d-40e4-8ab8-2c40d0a41850 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.250462 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df256c6b-202d-40e4-8ab8-2c40d0a41850 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.250986 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df256c6b-202d-40e4-8ab8-2c40d0a41850 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.251964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df256c6b-202d-40e4-8ab8-2c40d0a41850 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:03.252568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df256c6b-202d-40e4-8ab8-2c40d0a41850 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:03.255221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df256c6b-202d-40e4-8ab8-2c40d0a41850 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:03.267944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 370/761] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:16:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:03.275325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686d605-b936-4982-89c3-5f9656e5c581 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:03.286426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686d605-b936-4982-89c3-5f9656e5c581 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:03.291394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20451d63-49e9-439a-afb3-00b3c0b5b730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:03.292262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20451d63-49e9-439a-afb3-00b3c0b5b730 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.292796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20451d63-49e9-439a-afb3-00b3c0b5b730 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.293290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20451d63-49e9-439a-afb3-00b3c0b5b730 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.294411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20451d63-49e9-439a-afb3-00b3c0b5b730 admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=861c258c3fbf470fac4af9966ac5f0c5) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:03.294991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20451d63-49e9-439a-afb3-00b3c0b5b730 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:03.297196 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20451d63-49e9-439a-afb3-00b3c0b5b730 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:03.303981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 392/762] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:03 2021] GET /identity/v3/role_assignments?user.id=861c258c3fbf470fac4af9966ac5f0c5&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:03.882317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1514d-69d7-45ff-a79c-87cc2fdd73c5 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.882752 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1514d-69d7-45ff-a79c-87cc2fdd73c5 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.882935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1514d-69d7-45ff-a79c-87cc2fdd73c5 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.885037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 371/763] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:03.891707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026849c4-bf51-4c9a-b68b-9ebdfa19c2d3 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.891998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026849c4-bf51-4c9a-b68b-9ebdfa19c2d3 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.892267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026849c4-bf51-4c9a-b68b-9ebdfa19c2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.911237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-026849c4-bf51-4c9a-b68b-9ebdfa19c2d3 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:03.912421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-026849c4-bf51-4c9a-b68b-9ebdfa19c2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:03.920440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 393/764] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:03 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:03.943635 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026849c4-bf51-4c9a-b68b-9ebdfa19c2d3 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:03.944009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc7f21-7df2-4bd1-ad95-3d211e82586c None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.944299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc7f21-7df2-4bd1-ad95-3d211e82586c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.944575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc7f21-7df2-4bd1-ad95-3d211e82586c None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.946581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 372/765] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:03.952374 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c1708-4a0a-40ee-b881-5a9ce2f45cd7 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.952626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026849c4-bf51-4c9a-b68b-9ebdfa19c2d3 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:03.952749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c1708-4a0a-40ee-b881-5a9ce2f45cd7 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.952944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c1708-4a0a-40ee-b881-5a9ce2f45cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.957559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee137c-81f7-4e90-9d4a-ec6a60c4d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:03.958346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee137c-81f7-4e90-9d4a-ec6a60c4d325 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:03.958627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee137c-81f7-4e90-9d4a-ec6a60c4d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:03.958984 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee137c-81f7-4e90-9d4a-ec6a60c4d325 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:03.959694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee137c-81f7-4e90-9d4a-ec6a60c4d325 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:03.961294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee137c-81f7-4e90-9d4a-ec6a60c4d325 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:03.970335 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b77c1708-4a0a-40ee-b881-5a9ce2f45cd7 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:03.971689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b77c1708-4a0a-40ee-b881-5a9ce2f45cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:03.973556 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-a5ee137c-81f7-4e90-9d4a-ec6a60c4d325 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 01:16:03.975080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 394/766] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:16:03 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:03.981192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 373/767] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:03 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:03.982370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee137c-81f7-4e90-9d4a-ec6a60c4d325 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:03.996661 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee137c-81f7-4e90-9d4a-ec6a60c4d325 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:04.001352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b2ef-4c3e-4cbe-9a45-532a3ba75f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:04.002106 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b2ef-4c3e-4cbe-9a45-532a3ba75f57 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.002454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b2ef-4c3e-4cbe-9a45-532a3ba75f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.002852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b2ef-4c3e-4cbe-9a45-532a3ba75f57 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.003651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8b2ef-4c3e-4cbe-9a45-532a3ba75f57 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:04.004070 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8b2ef-4c3e-4cbe-9a45-532a3ba75f57 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:04.005866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c1708-4a0a-40ee-b881-5a9ce2f45cd7 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:04.006015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8b2ef-4c3e-4cbe-9a45-532a3ba75f57 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:04.011102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 395/768] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:16:03 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:04.015037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c1708-4a0a-40ee-b881-5a9ce2f45cd7 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:04.017357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b2ef-4c3e-4cbe-9a45-532a3ba75f57 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:04.020185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dd0b7-8a51-4934-8ead-4c646f2d52e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:04.021079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dd0b7-8a51-4934-8ead-4c646f2d52e2 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.021582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dd0b7-8a51-4934-8ead-4c646f2d52e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.022073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dd0b7-8a51-4934-8ead-4c646f2d52e2 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.023028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dd0b7-8a51-4934-8ead-4c646f2d52e2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:04.024809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dd0b7-8a51-4934-8ead-4c646f2d52e2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:04.027152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b2ef-4c3e-4cbe-9a45-532a3ba75f57 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:04.032007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb39176-02cb-44ab-a8a6-d668dc39461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:04.032734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb39176-02cb-44ab-a8a6-d668dc39461b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.033020 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb39176-02cb-44ab-a8a6-d668dc39461b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.033295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb39176-02cb-44ab-a8a6-d668dc39461b admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.034075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb39176-02cb-44ab-a8a6-d668dc39461b admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:04.034428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb39176-02cb-44ab-a8a6-d668dc39461b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:04.036762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb39176-02cb-44ab-a8a6-d668dc39461b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:04.042155 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 396/769] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:16:04 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:04.042767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 374/770] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:16:04 2021] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:16:04.613480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af78e-ddca-46c7-866d-6772672bbd80 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.614476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af78e-ddca-46c7-866d-6772672bbd80 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.615008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af78e-ddca-46c7-866d-6772672bbd80 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.617192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 397/771] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:04.623365 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1479f-0cd6-4a59-814b-01a7e5e53fa1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.624170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1479f-0cd6-4a59-814b-01a7e5e53fa1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.624651 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1479f-0cd6-4a59-814b-01a7e5e53fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.642918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-8ec1479f-0cd6-4a59-814b-01a7e5e53fa1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:04.644951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8ec1479f-0cd6-4a59-814b-01a7e5e53fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:04.662054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 375/772] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:04 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:04.685944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096af78e-ddca-46c7-866d-6772672bbd80 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:04.698870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096af78e-ddca-46c7-866d-6772672bbd80 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:04.703478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b9bb6-02b6-41f7-89f6-177421e12461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:04.704492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b9bb6-02b6-41f7-89f6-177421e12461 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.704995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b9bb6-02b6-41f7-89f6-177421e12461 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.705467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b9bb6-02b6-41f7-89f6-177421e12461 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.716853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b9bb6-02b6-41f7-89f6-177421e12461 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:04.724394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-eb6b9bb6-02b6-41f7-89f6-177421e12461 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 01:16:04.726015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 398/773] 10.222.0.23 () {56 vars in 1142 bytes} [Wed Aug 25 01:16:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:04.732687 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1479f-0cd6-4a59-814b-01a7e5e53fa1 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:04.741840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1479f-0cd6-4a59-814b-01a7e5e53fa1 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:04.746573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47210b5d-cbf5-4f0c-a379-93aeb94d034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:04.747519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47210b5d-cbf5-4f0c-a379-93aeb94d034b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.748013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47210b5d-cbf5-4f0c-a379-93aeb94d034b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.748502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47210b5d-cbf5-4f0c-a379-93aeb94d034b admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.749462 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47210b5d-cbf5-4f0c-a379-93aeb94d034b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:04.749987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47210b5d-cbf5-4f0c-a379-93aeb94d034b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:04.751779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47210b5d-cbf5-4f0c-a379-93aeb94d034b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:04.761752 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 376/774] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 25 01:16:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:04.768352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b9bb6-02b6-41f7-89f6-177421e12461 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:04.779078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b9bb6-02b6-41f7-89f6-177421e12461 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:04.783875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201435-fe68-489e-80c1-2762f02bad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:04.784936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201435-fe68-489e-80c1-2762f02bad76 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.785437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201435-fe68-489e-80c1-2762f02bad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.785928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201435-fe68-489e-80c1-2762f02bad76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.796446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b201435-fe68-489e-80c1-2762f02bad76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:04.798529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b201435-fe68-489e-80c1-2762f02bad76 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:04.815823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-5b201435-fe68-489e-80c1-2762f02bad76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:04.818075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 399/775] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:04.824476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47210b5d-cbf5-4f0c-a379-93aeb94d034b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:04.835221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47210b5d-cbf5-4f0c-a379-93aeb94d034b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:04.840096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2777f1-a6c7-4060-a18b-9c3394e656b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:04.841049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2777f1-a6c7-4060-a18b-9c3394e656b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.841589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2777f1-a6c7-4060-a18b-9c3394e656b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.842069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2777f1-a6c7-4060-a18b-9c3394e656b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.843067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2777f1-a6c7-4060-a18b-9c3394e656b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:04.843592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2777f1-a6c7-4060-a18b-9c3394e656b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:04.845426 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2777f1-a6c7-4060-a18b-9c3394e656b5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:04.859720 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 377/776] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:04.866600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201435-fe68-489e-80c1-2762f02bad76 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:04.878602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201435-fe68-489e-80c1-2762f02bad76 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:04.883697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5a08f-f403-45b6-beda-f6d92f5a1e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:04.884567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5a08f-f403-45b6-beda-f6d92f5a1e08 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.884851 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5a08f-f403-45b6-beda-f6d92f5a1e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.885128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5a08f-f403-45b6-beda-f6d92f5a1e08 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.893423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5a08f-f403-45b6-beda-f6d92f5a1e08 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:04.895592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5a08f-f403-45b6-beda-f6d92f5a1e08 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:04.911005 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-cac5a08f-f403-45b6-beda-f6d92f5a1e08 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 01:16:04.912477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 400/777] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 25 01:16:04 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:04.918524 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2777f1-a6c7-4060-a18b-9c3394e656b5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:04.929985 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2777f1-a6c7-4060-a18b-9c3394e656b5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:04.934753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc7b7-bc65-4aa1-893b-2484edd611a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:04.935437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc7b7-bc65-4aa1-893b-2484edd611a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.935721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc7b7-bc65-4aa1-893b-2484edd611a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.936048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc7b7-bc65-4aa1-893b-2484edd611a4 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.936888 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dc7b7-bc65-4aa1-893b-2484edd611a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:04.937250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dc7b7-bc65-4aa1-893b-2484edd611a4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:04.939200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dc7b7-bc65-4aa1-893b-2484edd611a4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:04.962809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 378/778] 10.222.0.23 () {56 vars in 1171 bytes} [Wed Aug 25 01:16:04 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:04.964586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5a08f-f403-45b6-beda-f6d92f5a1e08 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:04.975267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5a08f-f403-45b6-beda-f6d92f5a1e08 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:04.980063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f04dc-88f8-4aad-8c85-adbb9ae221bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:04.980713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f04dc-88f8-4aad-8c85-adbb9ae221bb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:04.981045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f04dc-88f8-4aad-8c85-adbb9ae221bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:04.981324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f04dc-88f8-4aad-8c85-adbb9ae221bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:04.989577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f04dc-88f8-4aad-8c85-adbb9ae221bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:04.991442 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f04dc-88f8-4aad-8c85-adbb9ae221bb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:05.005824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 401/779] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:04 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:05.007191 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc7b7-bc65-4aa1-893b-2484edd611a4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:05.017235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc7b7-bc65-4aa1-893b-2484edd611a4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:05.022530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674bfc1-020e-4895-97b3-097aa042e732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:05.023355 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674bfc1-020e-4895-97b3-097aa042e732 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:05.023642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674bfc1-020e-4895-97b3-097aa042e732 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:05.023917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674bfc1-020e-4895-97b3-097aa042e732 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:05.034232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674bfc1-020e-4895-97b3-097aa042e732 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:05.036639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674bfc1-020e-4895-97b3-097aa042e732 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:05.053265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-e674bfc1-020e-4895-97b3-097aa042e732 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:05.059042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 379/780] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:05.061223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f04dc-88f8-4aad-8c85-adbb9ae221bb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:05.070163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f04dc-88f8-4aad-8c85-adbb9ae221bb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:05.074728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e8adb-0317-4e83-ace9-4520bba6ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:05.075388 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8adb-0317-4e83-ace9-4520bba6ef23 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:05.075673 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8adb-0317-4e83-ace9-4520bba6ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:05.075953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8adb-0317-4e83-ace9-4520bba6ef23 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:05.076719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e8adb-0317-4e83-ace9-4520bba6ef23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:05.077034 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e8adb-0317-4e83-ace9-4520bba6ef23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:05.078639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e8adb-0317-4e83-ace9-4520bba6ef23 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:05.094787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 402/781] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:05.097067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674bfc1-020e-4895-97b3-097aa042e732 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:05.107476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674bfc1-020e-4895-97b3-097aa042e732 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:05.112040 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c4bb-54f1-4a7f-bf65-dd42bcb11dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:05.112826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c4bb-54f1-4a7f-bf65-dd42bcb11dfa admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:05.113146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c4bb-54f1-4a7f-bf65-dd42bcb11dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:05.113425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c4bb-54f1-4a7f-bf65-dd42bcb11dfa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:05.120661 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c4bb-54f1-4a7f-bf65-dd42bcb11dfa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:05.122601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c4bb-54f1-4a7f-bf65-dd42bcb11dfa admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:05.135833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-b281c4bb-54f1-4a7f-bf65-dd42bcb11dfa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:16:05.142619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 380/782] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:05.143994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e8adb-0317-4e83-ace9-4520bba6ef23 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:05.154274 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e8adb-0317-4e83-ace9-4520bba6ef23 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:05.158904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbf3da-ead4-4632-9560-67b5fcec6911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:05.159561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbf3da-ead4-4632-9560-67b5fcec6911 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:05.159896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbf3da-ead4-4632-9560-67b5fcec6911 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:05.160663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbf3da-ead4-4632-9560-67b5fcec6911 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:05.161446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbf3da-ead4-4632-9560-67b5fcec6911 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:05.161776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbf3da-ead4-4632-9560-67b5fcec6911 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:05.163638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbf3da-ead4-4632-9560-67b5fcec6911 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:05.181579 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 403/783] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:16:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:05.182955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c4bb-54f1-4a7f-bf65-dd42bcb11dfa admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:05.193538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c4bb-54f1-4a7f-bf65-dd42bcb11dfa admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:05.198154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a65bf-6e82-41e4-8d2b-545f842592e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:05.198822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a65bf-6e82-41e4-8d2b-545f842592e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:05.199107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a65bf-6e82-41e4-8d2b-545f842592e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:05.199383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a65bf-6e82-41e4-8d2b-545f842592e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:05.200215 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a65bf-6e82-41e4-8d2b-545f842592e8 admin admin] RBAC: Adding query filter params (role.id=1a8543e154214990bd46ec2d9719d019, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=bf5aac81feed4af7b9969937afe5a5a5) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:05.200531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a65bf-6e82-41e4-8d2b-545f842592e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:05.202352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a65bf-6e82-41e4-8d2b-545f842592e8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:05.214859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 381/784] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:05 2021] GET /identity/v3/role_assignments?user.id=bf5aac81feed4af7b9969937afe5a5a5&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=1a8543e154214990bd46ec2d9719d019 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:05.593672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdb6d0-3f0e-4930-ada8-bfbfea0d0db4 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:05.594001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdb6d0-3f0e-4930-ada8-bfbfea0d0db4 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:05.594236 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdb6d0-3f0e-4930-ada8-bfbfea0d0db4 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:05.596284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 404/785] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:05.602249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec9f85-1b87-4a4e-864d-ad2dc3e76452 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:05.602555 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec9f85-1b87-4a4e-864d-ad2dc3e76452 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:05.602867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec9f85-1b87-4a4e-864d-ad2dc3e76452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:05.620177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b8ec9f85-1b87-4a4e-864d-ad2dc3e76452 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:05.621368 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b8ec9f85-1b87-4a4e-864d-ad2dc3e76452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:05.629854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 382/786] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:05 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:05.653998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdb6d0-3f0e-4930-ada8-bfbfea0d0db4 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:05.666626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdb6d0-3f0e-4930-ada8-bfbfea0d0db4 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:05.671086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037ad6-b1ec-4264-8eb7-feb8254de75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:05.671877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037ad6-b1ec-4264-8eb7-feb8254de75d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:05.672222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037ad6-b1ec-4264-8eb7-feb8254de75d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:05.672501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037ad6-b1ec-4264-8eb7-feb8254de75d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:05.673207 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de037ad6-b1ec-4264-8eb7-feb8254de75d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:05.674829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de037ad6-b1ec-4264-8eb7-feb8254de75d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:05.686224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-de037ad6-b1ec-4264-8eb7-feb8254de75d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 01:16:05.687687 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 405/787] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:05 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:05.694822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec9f85-1b87-4a4e-864d-ad2dc3e76452 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:05.703839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec9f85-1b87-4a4e-864d-ad2dc3e76452 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:05.709037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0750a6-1ffd-4360-8f15-2997a845ec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:05.709638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0750a6-1ffd-4360-8f15-2997a845ec12 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:05.709923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0750a6-1ffd-4360-8f15-2997a845ec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:05.710203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0750a6-1ffd-4360-8f15-2997a845ec12 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:05.710953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0750a6-1ffd-4360-8f15-2997a845ec12 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:05.711264 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0750a6-1ffd-4360-8f15-2997a845ec12 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:05.712863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0750a6-1ffd-4360-8f15-2997a845ec12 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:05.717759 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 383/788] 10.222.0.23 () {56 vars in 1144 bytes} [Wed Aug 25 01:16:05 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:05.723929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037ad6-b1ec-4264-8eb7-feb8254de75d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:05.734140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037ad6-b1ec-4264-8eb7-feb8254de75d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:05.739459 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d62ff8-afdb-4ce8-bde5-00682f0b44d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:05.740168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62ff8-afdb-4ce8-bde5-00682f0b44d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:05.740509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62ff8-afdb-4ce8-bde5-00682f0b44d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:05.740792 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62ff8-afdb-4ce8-bde5-00682f0b44d2 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:05.741499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d62ff8-afdb-4ce8-bde5-00682f0b44d2 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:05.741807 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d62ff8-afdb-4ce8-bde5-00682f0b44d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:05.743757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d62ff8-afdb-4ce8-bde5-00682f0b44d2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:05.748714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 406/789] 10.222.0.23 () {56 vars in 1144 bytes} [Wed Aug 25 01:16:05 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:06.244975 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4d78-5db9-429a-8602-c2291c17428d None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:06.245369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4d78-5db9-429a-8602-c2291c17428d None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:06.245564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4d78-5db9-429a-8602-c2291c17428d None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:06.247691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 384/790] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:06.254740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad8e8-422c-4887-a101-c43dfe62b4db None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:06.255038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad8e8-422c-4887-a101-c43dfe62b4db None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:06.255293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad8e8-422c-4887-a101-c43dfe62b4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:06.274900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c9cad8e8-422c-4887-a101-c43dfe62b4db None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:06.276239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c9cad8e8-422c-4887-a101-c43dfe62b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:06.289078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 407/791] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:06 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:06.311863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b4d78-5db9-429a-8602-c2291c17428d None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:06.324408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b4d78-5db9-429a-8602-c2291c17428d None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:06.328728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952eb76-2a22-4a57-98a0-0e6b4bffee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:06.329372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952eb76-2a22-4a57-98a0-0e6b4bffee1f admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:06.329649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952eb76-2a22-4a57-98a0-0e6b4bffee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:06.329922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952eb76-2a22-4a57-98a0-0e6b4bffee1f admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:06.330643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952eb76-2a22-4a57-98a0-0e6b4bffee1f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:06.332918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952eb76-2a22-4a57-98a0-0e6b4bffee1f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:06.336735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dc41e-a2d9-421f-80d2-650b928c3d35 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:06.336735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dc41e-a2d9-421f-80d2-650b928c3d35 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:06.336735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dc41e-a2d9-421f-80d2-650b928c3d35 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:06.338022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 408/792] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:16:06.344237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d31fa0-353c-4ffa-bb49-79cc1cebda61 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:06.344846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d31fa0-353c-4ffa-bb49-79cc1cebda61 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:06.345488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d31fa0-353c-4ffa-bb49-79cc1cebda61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:06.348510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 385/793] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:16:06 2021] POST /identity/v3/services => generated 251 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:06.365666 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e6d31fa0-353c-4ffa-bb49-79cc1cebda61 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:06.367429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e6d31fa0-353c-4ffa-bb49-79cc1cebda61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:06.388555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 409/794] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:06 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:06.414037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952eb76-2a22-4a57-98a0-0e6b4bffee1f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:06.424528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952eb76-2a22-4a57-98a0-0e6b4bffee1f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:06.429106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ef2c1-efc7-441a-bd1a-23d2e88e4abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:06.429932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ef2c1-efc7-441a-bd1a-23d2e88e4abe admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:06.430212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ef2c1-efc7-441a-bd1a-23d2e88e4abe admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:06.430489 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ef2c1-efc7-441a-bd1a-23d2e88e4abe admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:06.431185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ef2c1-efc7-441a-bd1a-23d2e88e4abe admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:06.432793 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ef2c1-efc7-441a-bd1a-23d2e88e4abe admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:06.445486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-fb0ef2c1-efc7-441a-bd1a-23d2e88e4abe admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 01:16:06.447080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 386/795] 10.222.0.23 () {56 vars in 1154 bytes} [Wed Aug 25 01:16:06 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:06.453817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d31fa0-353c-4ffa-bb49-79cc1cebda61 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:06.464463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d31fa0-353c-4ffa-bb49-79cc1cebda61 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:06.469513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4f7e8-cf40-4ba6-982d-4ab3581421a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:06.470571 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f7e8-cf40-4ba6-982d-4ab3581421a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:06.471171 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f7e8-cf40-4ba6-982d-4ab3581421a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:06.471652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f7e8-cf40-4ba6-982d-4ab3581421a1 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:06.472635 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4f7e8-cf40-4ba6-982d-4ab3581421a1 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:06.473148 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4f7e8-cf40-4ba6-982d-4ab3581421a1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:06.475126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4f7e8-cf40-4ba6-982d-4ab3581421a1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:06.482881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 410/796] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:06 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:06.490336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ef2c1-efc7-441a-bd1a-23d2e88e4abe admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:06.500557 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ef2c1-efc7-441a-bd1a-23d2e88e4abe admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:06.505785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154440f8-3424-471a-926f-95d63e188019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:06.506455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154440f8-3424-471a-926f-95d63e188019 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:06.506827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154440f8-3424-471a-926f-95d63e188019 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:06.507045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154440f8-3424-471a-926f-95d63e188019 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:06.507758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154440f8-3424-471a-926f-95d63e188019 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:06.508132 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154440f8-3424-471a-926f-95d63e188019 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:06.509640 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154440f8-3424-471a-926f-95d63e188019 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:06.515816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 387/797] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:06 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:06.522342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4f7e8-cf40-4ba6-982d-4ab3581421a1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:06.533002 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4f7e8-cf40-4ba6-982d-4ab3581421a1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:06.538044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c76111-92f6-4daa-93c1-14721dac994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:06.539021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c76111-92f6-4daa-93c1-14721dac994e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:06.539507 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c76111-92f6-4daa-93c1-14721dac994e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:06.539982 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c76111-92f6-4daa-93c1-14721dac994e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:06.540969 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c76111-92f6-4daa-93c1-14721dac994e admin admin] RBAC: Adding query filter params (interface=public, service_id=b091ab04af10465e815fca6444e2ee3e, region_id=RegionOne) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:06.541493 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c76111-92f6-4daa-93c1-14721dac994e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:06.543137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c76111-92f6-4daa-93c1-14721dac994e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:06.549354 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 411/798] 10.222.0.23 () {56 vars in 1273 bytes} [Wed Aug 25 01:16:06 2021] GET /identity/v3/endpoints?service_id=b091ab04af10465e815fca6444e2ee3e&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:06.556001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154440f8-3424-471a-926f-95d63e188019 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:06.568364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154440f8-3424-471a-926f-95d63e188019 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:06.573778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bba13-f26c-45e5-abfd-685e69ccaf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:06.574507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bba13-f26c-45e5-abfd-685e69ccaf24 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:06.574883 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bba13-f26c-45e5-abfd-685e69ccaf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:06.575162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bba13-f26c-45e5-abfd-685e69ccaf24 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:06.575841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bba13-f26c-45e5-abfd-685e69ccaf24 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:06.577410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bba13-f26c-45e5-abfd-685e69ccaf24 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:06.583586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 388/799] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:16:06 2021] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:16:07.379750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb9373-bccd-4ebb-a26e-23b1034a373f None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.380763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb9373-bccd-4ebb-a26e-23b1034a373f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.381275 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb9373-bccd-4ebb-a26e-23b1034a373f None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.383585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 412/800] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:07.389434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6f665-5794-4f11-9dac-78b5263d9017 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.389829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6f665-5794-4f11-9dac-78b5263d9017 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.389996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6f665-5794-4f11-9dac-78b5263d9017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.408246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-0dc6f665-5794-4f11-9dac-78b5263d9017 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:07.409431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0dc6f665-5794-4f11-9dac-78b5263d9017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:07.418844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 389/801] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:07 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:07.442789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb9373-bccd-4ebb-a26e-23b1034a373f None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.455445 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb9373-bccd-4ebb-a26e-23b1034a373f None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.460952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48bf09-6a54-4ae8-a817-40dd0e37a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.462001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48bf09-6a54-4ae8-a817-40dd0e37a4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.462489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48bf09-6a54-4ae8-a817-40dd0e37a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.463022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48bf09-6a54-4ae8-a817-40dd0e37a4b6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.474328 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48bf09-6a54-4ae8-a817-40dd0e37a4b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:07.482018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-bf48bf09-6a54-4ae8-a817-40dd0e37a4b6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 01:16:07.483903 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 413/802] 10.222.0.23 () {56 vars in 1142 bytes} [Wed Aug 25 01:16:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:07.490939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6f665-5794-4f11-9dac-78b5263d9017 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.500434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6f665-5794-4f11-9dac-78b5263d9017 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.505354 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163b043-fab6-463d-9a5a-679d61f34e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.506272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b043-fab6-463d-9a5a-679d61f34e04 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.506816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b043-fab6-463d-9a5a-679d61f34e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.507296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b043-fab6-463d-9a5a-679d61f34e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.510714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163b043-fab6-463d-9a5a-679d61f34e04 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:07.510714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163b043-fab6-463d-9a5a-679d61f34e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:07.510714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163b043-fab6-463d-9a5a-679d61f34e04 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:07.520088 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 390/803] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 25 01:16:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:07.527730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48bf09-6a54-4ae8-a817-40dd0e37a4b6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.538522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48bf09-6a54-4ae8-a817-40dd0e37a4b6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.543029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c5f02-2df0-4186-9782-64fd75c427f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.543806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c5f02-2df0-4186-9782-64fd75c427f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.544089 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c5f02-2df0-4186-9782-64fd75c427f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.544364 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c5f02-2df0-4186-9782-64fd75c427f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.554705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c5f02-2df0-4186-9782-64fd75c427f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:07.556604 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c5f02-2df0-4186-9782-64fd75c427f3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:07.573956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-8b6c5f02-2df0-4186-9782-64fd75c427f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:07.575505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 414/804] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:07.582324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163b043-fab6-463d-9a5a-679d61f34e04 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.592554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163b043-fab6-463d-9a5a-679d61f34e04 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.597808 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478315-b47b-4829-8296-383c6a0818db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.598863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478315-b47b-4829-8296-383c6a0818db admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.599361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478315-b47b-4829-8296-383c6a0818db admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.599853 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478315-b47b-4829-8296-383c6a0818db admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.600815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4478315-b47b-4829-8296-383c6a0818db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:07.601330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4478315-b47b-4829-8296-383c6a0818db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:07.603204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4478315-b47b-4829-8296-383c6a0818db admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:07.618787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 391/805] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:07.622604 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c5f02-2df0-4186-9782-64fd75c427f3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.633474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c5f02-2df0-4186-9782-64fd75c427f3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.638892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667b49-5d07-46cb-93df-6f56e65600ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.640009 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667b49-5d07-46cb-93df-6f56e65600ef admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.640487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667b49-5d07-46cb-93df-6f56e65600ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.641002 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667b49-5d07-46cb-93df-6f56e65600ef admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.649772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667b49-5d07-46cb-93df-6f56e65600ef admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:07.652157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667b49-5d07-46cb-93df-6f56e65600ef admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:07.667418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-16667b49-5d07-46cb-93df-6f56e65600ef admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 01:16:07.672901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 415/806] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 25 01:16:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:07.676194 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478315-b47b-4829-8296-383c6a0818db admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.686277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4478315-b47b-4829-8296-383c6a0818db admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.691745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b727a0d-7602-420b-b5ba-4ea851f4a992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.692686 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b727a0d-7602-420b-b5ba-4ea851f4a992 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.693194 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b727a0d-7602-420b-b5ba-4ea851f4a992 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.693681 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b727a0d-7602-420b-b5ba-4ea851f4a992 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.694775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b727a0d-7602-420b-b5ba-4ea851f4a992 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:07.695329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b727a0d-7602-420b-b5ba-4ea851f4a992 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:07.697453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b727a0d-7602-420b-b5ba-4ea851f4a992 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:07.720923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 392/807] 10.222.0.23 () {56 vars in 1171 bytes} [Wed Aug 25 01:16:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:07.722561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667b49-5d07-46cb-93df-6f56e65600ef admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.732945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667b49-5d07-46cb-93df-6f56e65600ef admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.737834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5b150-205b-4737-9d7a-5c734eae5038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.738978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b150-205b-4737-9d7a-5c734eae5038 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.739461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b150-205b-4737-9d7a-5c734eae5038 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.739980 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b150-205b-4737-9d7a-5c734eae5038 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.750469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5b150-205b-4737-9d7a-5c734eae5038 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:07.752674 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5b150-205b-4737-9d7a-5c734eae5038 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:07.771732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-a9e5b150-205b-4737-9d7a-5c734eae5038 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:07.777672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 416/808] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:07.780172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b727a0d-7602-420b-b5ba-4ea851f4a992 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.790915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b727a0d-7602-420b-b5ba-4ea851f4a992 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.796134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9ee96-a1a1-46ef-9dd9-3360fff76313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.797190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9ee96-a1a1-46ef-9dd9-3360fff76313 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.797676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9ee96-a1a1-46ef-9dd9-3360fff76313 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.798201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9ee96-a1a1-46ef-9dd9-3360fff76313 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.799203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9ee96-a1a1-46ef-9dd9-3360fff76313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:07.799741 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9ee96-a1a1-46ef-9dd9-3360fff76313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:07.801655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9ee96-a1a1-46ef-9dd9-3360fff76313 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:07.815286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 393/809] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:07.821721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5b150-205b-4737-9d7a-5c734eae5038 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.831458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5b150-205b-4737-9d7a-5c734eae5038 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.836530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135472e-b356-4834-819c-69006873519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.837313 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135472e-b356-4834-819c-69006873519c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.837590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135472e-b356-4834-819c-69006873519c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.837862 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135472e-b356-4834-819c-69006873519c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.845087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135472e-b356-4834-819c-69006873519c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:07.847088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135472e-b356-4834-819c-69006873519c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:07.860478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-0135472e-b356-4834-819c-69006873519c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:16:07.866778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 417/810] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:07.868909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9ee96-a1a1-46ef-9dd9-3360fff76313 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.880316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9ee96-a1a1-46ef-9dd9-3360fff76313 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.885304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45571df-9d8d-4f64-bae3-2369c61e4546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.886201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45571df-9d8d-4f64-bae3-2369c61e4546 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.886705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45571df-9d8d-4f64-bae3-2369c61e4546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.887206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45571df-9d8d-4f64-bae3-2369c61e4546 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.888472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45571df-9d8d-4f64-bae3-2369c61e4546 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:07.888958 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45571df-9d8d-4f64-bae3-2369c61e4546 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:07.891175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45571df-9d8d-4f64-bae3-2369c61e4546 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:07.910841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 394/811] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:16:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:07.912952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135472e-b356-4834-819c-69006873519c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:07.924507 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135472e-b356-4834-819c-69006873519c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:07.930422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cafe38-b934-4080-b419-4a9b62da5047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:07.931716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cafe38-b934-4080-b419-4a9b62da5047 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:07.932231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cafe38-b934-4080-b419-4a9b62da5047 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:07.932681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cafe38-b934-4080-b419-4a9b62da5047 admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/bf5aac81feed4af7b9969937afe5a5a5/roles/1a8543e154214990bd46ec2d9719d019` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:07.935353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cafe38-b934-4080-b419-4a9b62da5047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=bf5aac81feed4af7b9969937afe5a5a5, role_id=1a8543e154214990bd46ec2d9719d019)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:07.938422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cafe38-b934-4080-b419-4a9b62da5047 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:07.962880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 418/812] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:16:07 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/bf5aac81feed4af7b9969937afe5a5a5/roles/1a8543e154214990bd46ec2d9719d019 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:16:08.003803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65221f-7993-4023-82a0-eff4f8a915d8 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.004467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65221f-7993-4023-82a0-eff4f8a915d8 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.004978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65221f-7993-4023-82a0-eff4f8a915d8 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.007300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 395/813] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:08.013469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16770d47-b55d-4639-97d7-2cc6413ef5ff None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.013966 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16770d47-b55d-4639-97d7-2cc6413ef5ff None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.014429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16770d47-b55d-4639-97d7-2cc6413ef5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.036405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-16770d47-b55d-4639-97d7-2cc6413ef5ff None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:08.037925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-16770d47-b55d-4639-97d7-2cc6413ef5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:08.101927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 419/814] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:08 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:08.125726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65221f-7993-4023-82a0-eff4f8a915d8 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:08.141887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65221f-7993-4023-82a0-eff4f8a915d8 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:08.147438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a89a75-c476-4834-b065-2d1e41204f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:08.148311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89a75-c476-4834-b065-2d1e41204f16 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.148811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89a75-c476-4834-b065-2d1e41204f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.149265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89a75-c476-4834-b065-2d1e41204f16 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.150183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a89a75-c476-4834-b065-2d1e41204f16 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:08.152125 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a89a75-c476-4834-b065-2d1e41204f16 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:08.171807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 396/815] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:16:08 2021] POST /identity/v3/services => generated 241 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:08.590030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db486c-33fe-4400-8c67-a43b8b91419a None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.590541 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db486c-33fe-4400-8c67-a43b8b91419a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.590651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db486c-33fe-4400-8c67-a43b8b91419a None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.592614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 420/816] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:08.598605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3c48d-ea37-463d-a35a-2d07aaf92b27 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.599020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3c48d-ea37-463d-a35a-2d07aaf92b27 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.599201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3c48d-ea37-463d-a35a-2d07aaf92b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.616961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-8cf3c48d-ea37-463d-a35a-2d07aaf92b27 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:08.618160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8cf3c48d-ea37-463d-a35a-2d07aaf92b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:08.634998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 397/817] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:08 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:08.658292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db486c-33fe-4400-8c67-a43b8b91419a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:08.670401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db486c-33fe-4400-8c67-a43b8b91419a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:08.674911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6bb07-f4f0-4610-9244-73aed4f87c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:08.675766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6bb07-f4f0-4610-9244-73aed4f87c2f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.676050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6bb07-f4f0-4610-9244-73aed4f87c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.676320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6bb07-f4f0-4610-9244-73aed4f87c2f admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.676963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6bb07-f4f0-4610-9244-73aed4f87c2f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:08.678570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6bb07-f4f0-4610-9244-73aed4f87c2f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:08.689575 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-34b6bb07-f4f0-4610-9244-73aed4f87c2f admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 01:16:08.691591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 421/818] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:16:08 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:08.698064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3c48d-ea37-463d-a35a-2d07aaf92b27 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:08.707704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3c48d-ea37-463d-a35a-2d07aaf92b27 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:08.712281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ada319-492a-4c46-9791-c134d3db56b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:08.712963 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ada319-492a-4c46-9791-c134d3db56b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.713249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ada319-492a-4c46-9791-c134d3db56b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.713527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ada319-492a-4c46-9791-c134d3db56b5 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.714239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ada319-492a-4c46-9791-c134d3db56b5 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:08.714545 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ada319-492a-4c46-9791-c134d3db56b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:08.716278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ada319-492a-4c46-9791-c134d3db56b5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:08.721482 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 398/819] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:16:08 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:08.727819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6bb07-f4f0-4610-9244-73aed4f87c2f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:08.739079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6bb07-f4f0-4610-9244-73aed4f87c2f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:08.744512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab5718-af57-4a78-ab0b-e8695b240d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:08.745591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab5718-af57-4a78-ab0b-e8695b240d89 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.746115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab5718-af57-4a78-ab0b-e8695b240d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.746606 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab5718-af57-4a78-ab0b-e8695b240d89 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.747615 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab5718-af57-4a78-ab0b-e8695b240d89 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:08.748146 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab5718-af57-4a78-ab0b-e8695b240d89 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:08.749973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab5718-af57-4a78-ab0b-e8695b240d89 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:08.756902 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 422/820] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:16:08 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:08.764112 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ada319-492a-4c46-9791-c134d3db56b5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:08.774434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ada319-492a-4c46-9791-c134d3db56b5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:08.779429 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0166e0-2208-4736-abe7-18151e18c983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:08.780343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0166e0-2208-4736-abe7-18151e18c983 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.780825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0166e0-2208-4736-abe7-18151e18c983 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.781335 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0166e0-2208-4736-abe7-18151e18c983 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.782310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0166e0-2208-4736-abe7-18151e18c983 admin admin] RBAC: Adding query filter params (interface=public, service_id=7168d1e731c94c38b23b7e3c5930a50a, region_id=RegionOne) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:08.782904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0166e0-2208-4736-abe7-18151e18c983 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:08.784185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-6f0166e0-2208-4736-abe7-18151e18c983 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:16:08.784185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:16:08.784185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:16:08.785466 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0166e0-2208-4736-abe7-18151e18c983 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:08.793384 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 399/821] 10.222.0.23 () {56 vars in 1273 bytes} [Wed Aug 25 01:16:08 2021] GET /identity/v3/endpoints?service_id=7168d1e731c94c38b23b7e3c5930a50a&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:08.799610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab5718-af57-4a78-ab0b-e8695b240d89 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:08.810863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab5718-af57-4a78-ab0b-e8695b240d89 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:08.813048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523ffe4-5fbb-4c30-badb-db9359b6aeca None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.813597 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523ffe4-5fbb-4c30-badb-db9359b6aeca None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.814071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523ffe4-5fbb-4c30-badb-db9359b6aeca None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.817149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 400/822] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:08.820344 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694a0d6-3ab5-4efe-ad91-20476846cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:08.821317 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694a0d6-3ab5-4efe-ad91-20476846cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.821794 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694a0d6-3ab5-4efe-ad91-20476846cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.822339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694a0d6-3ab5-4efe-ad91-20476846cc9a admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.823290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694a0d6-3ab5-4efe-ad91-20476846cc9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:08.823527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc8c09-cf63-4959-9697-4147b7a3c03a None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.823817 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc8c09-cf63-4959-9697-4147b7a3c03a None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.824101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc8c09-cf63-4959-9697-4147b7a3c03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.825880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694a0d6-3ab5-4efe-ad91-20476846cc9a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:08.834175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 423/823] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:16:08 2021] GET /identity/v3/services => generated 1497 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:16:08.844750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-f1fc8c09-cf63-4959-9697-4147b7a3c03a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:08.845972 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f1fc8c09-cf63-4959-9697-4147b7a3c03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:08.854089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 401/824] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:08 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:08.879421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694a0d6-3ab5-4efe-ad91-20476846cc9a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:08.892642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694a0d6-3ab5-4efe-ad91-20476846cc9a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:08.898574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de929ea2-6173-4027-90ab-0539399a21db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:08.899806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929ea2-6173-4027-90ab-0539399a21db admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.900291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929ea2-6173-4027-90ab-0539399a21db admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.900855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929ea2-6173-4027-90ab-0539399a21db admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.901793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de929ea2-6173-4027-90ab-0539399a21db admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:08.903800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de929ea2-6173-4027-90ab-0539399a21db admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:08.917284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-de929ea2-6173-4027-90ab-0539399a21db admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 01:16:08.919273 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 424/825] 10.222.0.23 () {56 vars in 1154 bytes} [Wed Aug 25 01:16:08 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:08.926729 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc8c09-cf63-4959-9697-4147b7a3c03a None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:08.935198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc8c09-cf63-4959-9697-4147b7a3c03a None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:08.940073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e031beb-67dd-4619-927c-1af511165787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:08.940753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e031beb-67dd-4619-927c-1af511165787 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.941082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e031beb-67dd-4619-927c-1af511165787 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.941355 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e031beb-67dd-4619-927c-1af511165787 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.942071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e031beb-67dd-4619-927c-1af511165787 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:08.942372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e031beb-67dd-4619-927c-1af511165787 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:08.943999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e031beb-67dd-4619-927c-1af511165787 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:08.949546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 402/826] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:08 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:08.955871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de929ea2-6173-4027-90ab-0539399a21db admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:08.967195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de929ea2-6173-4027-90ab-0539399a21db admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:08.971847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7f0a3-ebbd-4876-971f-5c3f5d9cb4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:08.973082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7f0a3-ebbd-4876-971f-5c3f5d9cb4dc admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:08.973365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7f0a3-ebbd-4876-971f-5c3f5d9cb4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:08.973637 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7f0a3-ebbd-4876-971f-5c3f5d9cb4dc admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:08.974362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7f0a3-ebbd-4876-971f-5c3f5d9cb4dc admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:08.974653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7f0a3-ebbd-4876-971f-5c3f5d9cb4dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:08.976307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7f0a3-ebbd-4876-971f-5c3f5d9cb4dc admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:08.982258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 425/827] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:08 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:08.988623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e031beb-67dd-4619-927c-1af511165787 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:08.999052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e031beb-67dd-4619-927c-1af511165787 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:09.004044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860c917-036e-4bb2-8fb1-06c6eba192c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:09.004762 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860c917-036e-4bb2-8fb1-06c6eba192c9 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:09.005049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860c917-036e-4bb2-8fb1-06c6eba192c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:09.005326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860c917-036e-4bb2-8fb1-06c6eba192c9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:09.006275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860c917-036e-4bb2-8fb1-06c6eba192c9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:09.007985 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860c917-036e-4bb2-8fb1-06c6eba192c9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:09.031458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 403/828] 10.222.0.23 () {60 vars in 1166 bytes} [Wed Aug 25 01:16:08 2021] POST /identity/v3/endpoints => generated 347 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:10.234348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab4d6-73ea-464d-a2a3-5b1506d1e4f4 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.234948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab4d6-73ea-464d-a2a3-5b1506d1e4f4 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.234948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab4d6-73ea-464d-a2a3-5b1506d1e4f4 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.237016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 426/829] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:10.243082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ca66-8cf3-4a4a-b44e-4a53f3a2c9ba None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.243890 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ca66-8cf3-4a4a-b44e-4a53f3a2c9ba None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.244392 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ca66-8cf3-4a4a-b44e-4a53f3a2c9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.262013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-4ae4ca66-8cf3-4a4a-b44e-4a53f3a2c9ba None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:10.263804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-4ae4ca66-8cf3-4a4a-b44e-4a53f3a2c9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:10.281929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 404/830] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:10 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:10.306939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afab4d6-73ea-464d-a2a3-5b1506d1e4f4 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.320053 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afab4d6-73ea-464d-a2a3-5b1506d1e4f4 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.324608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e440c-5e86-4f16-86cd-d057562220ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.325443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e440c-5e86-4f16-86cd-d057562220ab admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.325733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e440c-5e86-4f16-86cd-d057562220ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.326010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e440c-5e86-4f16-86cd-d057562220ab admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.337801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e440c-5e86-4f16-86cd-d057562220ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:10.345165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-3b5e440c-5e86-4f16-86cd-d057562220ab admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 01:16:10.346670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 427/831] 10.222.0.23 () {56 vars in 1142 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:10.354061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ca66-8cf3-4a4a-b44e-4a53f3a2c9ba None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.363330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ca66-8cf3-4a4a-b44e-4a53f3a2c9ba None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.368200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827e89e-4f88-4e51-af15-9865a5cd64ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.368849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827e89e-4f88-4e51-af15-9865a5cd64ce admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.369135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827e89e-4f88-4e51-af15-9865a5cd64ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.369411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827e89e-4f88-4e51-af15-9865a5cd64ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.370155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827e89e-4f88-4e51-af15-9865a5cd64ce admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:10.370463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827e89e-4f88-4e51-af15-9865a5cd64ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.372079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827e89e-4f88-4e51-af15-9865a5cd64ce admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.380643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 405/832] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:10.386828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e440c-5e86-4f16-86cd-d057562220ab admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.387359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d996-a39f-4430-8fa7-52d328ab070c None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.387655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d996-a39f-4430-8fa7-52d328ab070c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.387935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d996-a39f-4430-8fa7-52d328ab070c None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.390062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 406/833] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:10.396853 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3da9d-a5fb-45c5-bd80-cef9e2110ebf None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.397366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3da9d-a5fb-45c5-bd80-cef9e2110ebf None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.397863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3da9d-a5fb-45c5-bd80-cef9e2110ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.398939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e440c-5e86-4f16-86cd-d057562220ab admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.403718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3d5e-749f-454e-85bb-8819c25921c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.404491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3d5e-749f-454e-85bb-8819c25921c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.404770 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3d5e-749f-454e-85bb-8819c25921c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.405043 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3d5e-749f-454e-85bb-8819c25921c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.415877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac3d5e-749f-454e-85bb-8819c25921c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.417273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-25c3da9d-a5fb-45c5-bd80-cef9e2110ebf None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:10.417815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac3d5e-749f-454e-85bb-8819c25921c2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.418926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-25c3da9d-a5fb-45c5-bd80-cef9e2110ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:10.434969 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 407/834] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:10 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:10.435424 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-12ac3d5e-749f-454e-85bb-8819c25921c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:10.436863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 428/835] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:10.442829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3da9d-a5fb-45c5-bd80-cef9e2110ebf None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.452487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3da9d-a5fb-45c5-bd80-cef9e2110ebf None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.453484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3d5e-749f-454e-85bb-8819c25921c2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.458043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de613e8-7351-4261-97ea-406596e1d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.458996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de613e8-7351-4261-97ea-406596e1d181 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.459482 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de613e8-7351-4261-97ea-406596e1d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.459974 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de613e8-7351-4261-97ea-406596e1d181 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.460918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de613e8-7351-4261-97ea-406596e1d181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:10.461425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de613e8-7351-4261-97ea-406596e1d181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.463392 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de613e8-7351-4261-97ea-406596e1d181 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.464231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3d5e-749f-454e-85bb-8819c25921c2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.468730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36890a8-fc48-4962-b85a-bbf7325b0751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.469575 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36890a8-fc48-4962-b85a-bbf7325b0751 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.469859 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36890a8-fc48-4962-b85a-bbf7325b0751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.470127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36890a8-fc48-4962-b85a-bbf7325b0751 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.470837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36890a8-fc48-4962-b85a-bbf7325b0751 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.472959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36890a8-fc48-4962-b85a-bbf7325b0751 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.477937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 408/836] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:10.484111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de613e8-7351-4261-97ea-406596e1d181 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.484226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-c36890a8-fc48-4962-b85a-bbf7325b0751 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 01:16:10.485805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 429/837] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:10.492484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36890a8-fc48-4962-b85a-bbf7325b0751 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.495081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de613e8-7351-4261-97ea-406596e1d181 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.499832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc6712-068e-430f-aa3f-36e34e9044f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.500889 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc6712-068e-430f-aa3f-36e34e9044f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.501372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc6712-068e-430f-aa3f-36e34e9044f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.501841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc6712-068e-430f-aa3f-36e34e9044f3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.503383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36890a8-fc48-4962-b85a-bbf7325b0751 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.509853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80500935-4b22-4d87-8014-43b381670a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.510505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80500935-4b22-4d87-8014-43b381670a07 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.510785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80500935-4b22-4d87-8014-43b381670a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.511059 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80500935-4b22-4d87-8014-43b381670a07 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.511766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80500935-4b22-4d87-8014-43b381670a07 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:10.512069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80500935-4b22-4d87-8014-43b381670a07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.512328 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc6712-068e-430f-aa3f-36e34e9044f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.513918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80500935-4b22-4d87-8014-43b381670a07 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.515050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc6712-068e-430f-aa3f-36e34e9044f3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.525115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 430/838] 10.222.0.23 () {56 vars in 1144 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:10.526103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80500935-4b22-4d87-8014-43b381670a07 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.531060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-23dc6712-068e-430f-aa3f-36e34e9044f3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 01:16:10.532729 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 409/839] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:10.537298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80500935-4b22-4d87-8014-43b381670a07 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.540091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc6712-068e-430f-aa3f-36e34e9044f3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.540993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439665f-5ea8-4bfd-aa24-15b529ab8792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.541639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439665f-5ea8-4bfd-aa24-15b529ab8792 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.541917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439665f-5ea8-4bfd-aa24-15b529ab8792 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.542188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439665f-5ea8-4bfd-aa24-15b529ab8792 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.542925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439665f-5ea8-4bfd-aa24-15b529ab8792 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:10.543228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439665f-5ea8-4bfd-aa24-15b529ab8792 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.544801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439665f-5ea8-4bfd-aa24-15b529ab8792 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.550213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 431/840] 10.222.0.23 () {56 vars in 1144 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:10.551787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc6712-068e-430f-aa3f-36e34e9044f3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.556693 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439665f-5ea8-4bfd-aa24-15b529ab8792 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.558927 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3beede-de5e-47e8-b200-c19c534ff7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.559805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3beede-de5e-47e8-b200-c19c534ff7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.560305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3beede-de5e-47e8-b200-c19c534ff7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.560865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3beede-de5e-47e8-b200-c19c534ff7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.561896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3beede-de5e-47e8-b200-c19c534ff7a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:10.562419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3beede-de5e-47e8-b200-c19c534ff7a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.564658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3beede-de5e-47e8-b200-c19c534ff7a9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.566735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439665f-5ea8-4bfd-aa24-15b529ab8792 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.571785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ebefb-7811-47ba-8632-fc0f25586e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.572582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ebefb-7811-47ba-8632-fc0f25586e60 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.573006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ebefb-7811-47ba-8632-fc0f25586e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.573420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ebefb-7811-47ba-8632-fc0f25586e60 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.574355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ebefb-7811-47ba-8632-fc0f25586e60 admin admin] RBAC: Adding query filter params (interface=public, service_id=7991a6e1ebf94c1894c2fd15228d7224, region_id=RegionOne) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:10.574847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ebefb-7811-47ba-8632-fc0f25586e60 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.576543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ebefb-7811-47ba-8632-fc0f25586e60 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.587476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 410/842] 10.222.0.23 () {56 vars in 1171 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:10.587921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 432/842] 10.222.0.23 () {56 vars in 1273 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/endpoints?service_id=7991a6e1ebf94c1894c2fd15228d7224&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:10.591048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3beede-de5e-47e8-b200-c19c534ff7a9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.591331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ebefb-7811-47ba-8632-fc0f25586e60 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.600854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3beede-de5e-47e8-b200-c19c534ff7a9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.601174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ebefb-7811-47ba-8632-fc0f25586e60 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.605638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef633cf9-e0a3-40b5-a370-b23c0518f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.606279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb853992-c43a-4752-9467-7e0cb6cf271d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.606398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef633cf9-e0a3-40b5-a370-b23c0518f2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.606572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef633cf9-e0a3-40b5-a370-b23c0518f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.606870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef633cf9-e0a3-40b5-a370-b23c0518f2c9 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.607550 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef633cf9-e0a3-40b5-a370-b23c0518f2c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.607834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb853992-c43a-4752-9467-7e0cb6cf271d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.608302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb853992-c43a-4752-9467-7e0cb6cf271d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.608763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb853992-c43a-4752-9467-7e0cb6cf271d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.609124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef633cf9-e0a3-40b5-a370-b23c0518f2c9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.615598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 411/843] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:16:10.624095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb853992-c43a-4752-9467-7e0cb6cf271d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.625957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb853992-c43a-4752-9467-7e0cb6cf271d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.637075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 433/844] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:16:10.643866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef633cf9-e0a3-40b5-a370-b23c0518f2c9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.655072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef633cf9-e0a3-40b5-a370-b23c0518f2c9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.660082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2111614-cfd6-441b-8fb7-552ea5d5e27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.660948 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2111614-cfd6-441b-8fb7-552ea5d5e27d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.661234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2111614-cfd6-441b-8fb7-552ea5d5e27d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.661511 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2111614-cfd6-441b-8fb7-552ea5d5e27d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.673624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2111614-cfd6-441b-8fb7-552ea5d5e27d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.675649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2111614-cfd6-441b-8fb7-552ea5d5e27d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.695209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-f2111614-cfd6-441b-8fb7-552ea5d5e27d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:10.696866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 412/845] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:10.703331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb853992-c43a-4752-9467-7e0cb6cf271d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.713450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb853992-c43a-4752-9467-7e0cb6cf271d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.718272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa6705-e338-48a5-8b28-445612508c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.718996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa6705-e338-48a5-8b28-445612508c58 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.719456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa6705-e338-48a5-8b28-445612508c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.719739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa6705-e338-48a5-8b28-445612508c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.720476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa6705-e338-48a5-8b28-445612508c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:10.720785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa6705-e338-48a5-8b28-445612508c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.722510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa6705-e338-48a5-8b28-445612508c58 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.741011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 434/846] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:10.746882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2111614-cfd6-441b-8fb7-552ea5d5e27d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.758251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2111614-cfd6-441b-8fb7-552ea5d5e27d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.764145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd92ee-d04d-40c4-b684-d52daa750e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.765059 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd92ee-d04d-40c4-b684-d52daa750e57 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.765351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd92ee-d04d-40c4-b684-d52daa750e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.765634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd92ee-d04d-40c4-b684-d52daa750e57 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.774060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd92ee-d04d-40c4-b684-d52daa750e57 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.776077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd92ee-d04d-40c4-b684-d52daa750e57 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.790073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-61bd92ee-d04d-40c4-b684-d52daa750e57 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:16:10.792917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 413/847] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:10.798049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa6705-e338-48a5-8b28-445612508c58 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.808000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa6705-e338-48a5-8b28-445612508c58 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.812656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdcfb9-ef11-407a-9c91-90c5b139d952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.813377 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcfb9-ef11-407a-9c91-90c5b139d952 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.813657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcfb9-ef11-407a-9c91-90c5b139d952 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.813990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcfb9-ef11-407a-9c91-90c5b139d952 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.814818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdcfb9-ef11-407a-9c91-90c5b139d952 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:10.815184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdcfb9-ef11-407a-9c91-90c5b139d952 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.817588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdcfb9-ef11-407a-9c91-90c5b139d952 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.830461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 435/848] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:10.838195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd92ee-d04d-40c4-b684-d52daa750e57 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:10.849244 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd92ee-d04d-40c4-b684-d52daa750e57 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:10.854007 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe2720-c89f-4b62-b410-1e9652c057d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:10.854717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2720-c89f-4b62-b410-1e9652c057d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:10.855000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2720-c89f-4b62-b410-1e9652c057d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:10.855277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2720-c89f-4b62-b410-1e9652c057d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:10.856208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe2720-c89f-4b62-b410-1e9652c057d2 admin admin] RBAC: Adding query filter params (role.id=1a8543e154214990bd46ec2d9719d019, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=bf5aac81feed4af7b9969937afe5a5a5) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:10.856568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe2720-c89f-4b62-b410-1e9652c057d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:10.858459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe2720-c89f-4b62-b410-1e9652c057d2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:10.865534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 414/849] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:10 2021] GET /identity/v3/role_assignments?user.id=bf5aac81feed4af7b9969937afe5a5a5&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=1a8543e154214990bd46ec2d9719d019 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:11.058411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cef4d-7e5e-4256-a7e9-a7e1b61cc3fe None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.058855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cef4d-7e5e-4256-a7e9-a7e1b61cc3fe None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.059251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cef4d-7e5e-4256-a7e9-a7e1b61cc3fe None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.061390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 436/850] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:11.068343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f1a7b-252d-47b6-b586-4ed0dfdd99c7 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.068632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f1a7b-252d-47b6-b586-4ed0dfdd99c7 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.068911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f1a7b-252d-47b6-b586-4ed0dfdd99c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.087004 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-da2f1a7b-252d-47b6-b586-4ed0dfdd99c7 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:11.088195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-da2f1a7b-252d-47b6-b586-4ed0dfdd99c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:11.102343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 415/851] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:11 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:11.126279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cef4d-7e5e-4256-a7e9-a7e1b61cc3fe None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:11.139266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cef4d-7e5e-4256-a7e9-a7e1b61cc3fe None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:11.143628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee3bd5-b799-4db6-af2e-547b91e77ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:11.144440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee3bd5-b799-4db6-af2e-547b91e77ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.144719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee3bd5-b799-4db6-af2e-547b91e77ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.144993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee3bd5-b799-4db6-af2e-547b91e77ea6 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.145631 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee3bd5-b799-4db6-af2e-547b91e77ea6 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:11.147242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee3bd5-b799-4db6-af2e-547b91e77ea6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:11.158124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-07ee3bd5-b799-4db6-af2e-547b91e77ea6 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 01:16:11.164831 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 437/852] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:16:11 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:11.166162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f1a7b-252d-47b6-b586-4ed0dfdd99c7 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:11.176076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f1a7b-252d-47b6-b586-4ed0dfdd99c7 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:11.180978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255907-f87e-4570-866e-962344619d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:11.181662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255907-f87e-4570-866e-962344619d08 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.181942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255907-f87e-4570-866e-962344619d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.182216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255907-f87e-4570-866e-962344619d08 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.182977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8255907-f87e-4570-866e-962344619d08 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:11.183285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8255907-f87e-4570-866e-962344619d08 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:11.184930 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8255907-f87e-4570-866e-962344619d08 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:11.190598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 416/853] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:16:11 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:11.197982 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee3bd5-b799-4db6-af2e-547b91e77ea6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:11.208390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee3bd5-b799-4db6-af2e-547b91e77ea6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:11.213345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389b85-deac-4f17-b65e-3cdf430dd6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:11.214062 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389b85-deac-4f17-b65e-3cdf430dd6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.214340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389b85-deac-4f17-b65e-3cdf430dd6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.214664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389b85-deac-4f17-b65e-3cdf430dd6f4 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.215405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48389b85-deac-4f17-b65e-3cdf430dd6f4 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:11.215758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48389b85-deac-4f17-b65e-3cdf430dd6f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:11.217425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48389b85-deac-4f17-b65e-3cdf430dd6f4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:11.222958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 438/854] 10.222.0.23 () {56 vars in 1136 bytes} [Wed Aug 25 01:16:11 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:11.234043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255907-f87e-4570-866e-962344619d08 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:11.244606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255907-f87e-4570-866e-962344619d08 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:11.249225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889829f0-9f65-4366-ac2c-5525371d8084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:11.249917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889829f0-9f65-4366-ac2c-5525371d8084 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.250197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889829f0-9f65-4366-ac2c-5525371d8084 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.250470 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889829f0-9f65-4366-ac2c-5525371d8084 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.251281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889829f0-9f65-4366-ac2c-5525371d8084 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:11.252900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889829f0-9f65-4366-ac2c-5525371d8084 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:11.262927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe8c02-414a-46ad-b58b-b2898ba33ea5 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.263725 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe8c02-414a-46ad-b58b-b2898ba33ea5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.263804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe8c02-414a-46ad-b58b-b2898ba33ea5 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.265946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 439/855] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:16:11.272149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3889-00d4-485c-be97-22d5f34ef0af None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.272439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3889-00d4-485c-be97-22d5f34ef0af None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.272786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3889-00d4-485c-be97-22d5f34ef0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.276405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 417/856] 10.222.0.23 () {60 vars in 1166 bytes} [Wed Aug 25 01:16:11 2021] POST /identity/v3/endpoints => generated 346 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:16:11.292044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-66dd3889-00d4-485c-be97-22d5f34ef0af None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:11.293337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-66dd3889-00d4-485c-be97-22d5f34ef0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:11.313120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 440/857] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:11 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:11.336749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889829f0-9f65-4366-ac2c-5525371d8084 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:11.348692 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889829f0-9f65-4366-ac2c-5525371d8084 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:11.353198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cec67-05a6-42d3-8f8e-04d10094218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:11.354057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cec67-05a6-42d3-8f8e-04d10094218e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.354348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cec67-05a6-42d3-8f8e-04d10094218e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.354631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cec67-05a6-42d3-8f8e-04d10094218e admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.355378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cec67-05a6-42d3-8f8e-04d10094218e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:11.357066 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cec67-05a6-42d3-8f8e-04d10094218e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:11.369617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-707cec67-05a6-42d3-8f8e-04d10094218e admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 01:16:11.371221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 418/858] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:11 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:11.378046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd3889-00d4-485c-be97-22d5f34ef0af None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:11.387764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd3889-00d4-485c-be97-22d5f34ef0af None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:11.392811 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0371368-1a6d-4ebf-bbd1-4c1cdbddd34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:11.393493 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371368-1a6d-4ebf-bbd1-4c1cdbddd34c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.393828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371368-1a6d-4ebf-bbd1-4c1cdbddd34c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.394160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371368-1a6d-4ebf-bbd1-4c1cdbddd34c admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.394970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0371368-1a6d-4ebf-bbd1-4c1cdbddd34c admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:11.395282 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0371368-1a6d-4ebf-bbd1-4c1cdbddd34c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:11.396969 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0371368-1a6d-4ebf-bbd1-4c1cdbddd34c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:11.403168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 441/859] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:16:11 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:11.410464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cec67-05a6-42d3-8f8e-04d10094218e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:11.420957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cec67-05a6-42d3-8f8e-04d10094218e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:11.426497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfdb58-fb67-4384-a037-16d4a6f50687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:11.427254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfdb58-fb67-4384-a037-16d4a6f50687 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:11.427543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfdb58-fb67-4384-a037-16d4a6f50687 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:11.427823 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfdb58-fb67-4384-a037-16d4a6f50687 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:11.428600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfdb58-fb67-4384-a037-16d4a6f50687 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:11.428917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfdb58-fb67-4384-a037-16d4a6f50687 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:11.430581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfdb58-fb67-4384-a037-16d4a6f50687 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:11.436233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 419/860] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:16:11 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:12.848556 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b428c6-d7c5-42d4-b9f2-cde5802bd838 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:12.849245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b428c6-d7c5-42d4-b9f2-cde5802bd838 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:12.849245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b428c6-d7c5-42d4-b9f2-cde5802bd838 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:12.851070 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 442/861] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:12.857058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8adb-d89f-4093-a724-dd4ae942d896 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:12.857552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8adb-d89f-4093-a724-dd4ae942d896 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:12.857717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8adb-d89f-4093-a724-dd4ae942d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:12.875882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-ac4f8adb-d89f-4093-a724-dd4ae942d896 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:12.877071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ac4f8adb-d89f-4093-a724-dd4ae942d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:12.885122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 420/862] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:12 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:12.910282 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b428c6-d7c5-42d4-b9f2-cde5802bd838 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:12.922922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b428c6-d7c5-42d4-b9f2-cde5802bd838 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:12.928053 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dd306-c28c-44d8-84be-b61e5ec0f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:12.928847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd306-c28c-44d8-84be-b61e5ec0f944 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:12.929130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd306-c28c-44d8-84be-b61e5ec0f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:12.929404 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd306-c28c-44d8-84be-b61e5ec0f944 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:12.930051 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dd306-c28c-44d8-84be-b61e5ec0f944 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:12.931669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dd306-c28c-44d8-84be-b61e5ec0f944 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:12.943061 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-fa7dd306-c28c-44d8-84be-b61e5ec0f944 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 01:16:12.944500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 443/863] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:12 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:12.951181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f8adb-d89f-4093-a724-dd4ae942d896 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:12.960209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f8adb-d89f-4093-a724-dd4ae942d896 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:12.969277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472517f9-f603-4cf7-affb-d929dc1b6581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:12.969935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472517f9-f603-4cf7-affb-d929dc1b6581 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:12.970218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472517f9-f603-4cf7-affb-d929dc1b6581 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:12.970495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472517f9-f603-4cf7-affb-d929dc1b6581 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:12.971239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472517f9-f603-4cf7-affb-d929dc1b6581 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:12.971547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472517f9-f603-4cf7-affb-d929dc1b6581 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:12.973646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472517f9-f603-4cf7-affb-d929dc1b6581 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:12.978936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 421/864] 10.222.0.23 () {56 vars in 1144 bytes} [Wed Aug 25 01:16:12 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:12.985332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dd306-c28c-44d8-84be-b61e5ec0f944 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:12.995788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dd306-c28c-44d8-84be-b61e5ec0f944 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:13.000421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaf0ec-e473-4b35-8988-b7a8d76e677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:13.001075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaf0ec-e473-4b35-8988-b7a8d76e677a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.001362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaf0ec-e473-4b35-8988-b7a8d76e677a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.001643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaf0ec-e473-4b35-8988-b7a8d76e677a admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.002348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaf0ec-e473-4b35-8988-b7a8d76e677a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:13.002654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaf0ec-e473-4b35-8988-b7a8d76e677a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:13.004308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaf0ec-e473-4b35-8988-b7a8d76e677a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:13.009717 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 444/865] 10.222.0.23 () {56 vars in 1144 bytes} [Wed Aug 25 01:16:12 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:13.016367 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472517f9-f603-4cf7-affb-d929dc1b6581 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:13.026631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472517f9-f603-4cf7-affb-d929dc1b6581 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:13.031541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d9c0e-1180-4866-9261-f2f4c8c20f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:13.032220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d9c0e-1180-4866-9261-f2f4c8c20f7d admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.032505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d9c0e-1180-4866-9261-f2f4c8c20f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.032786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d9c0e-1180-4866-9261-f2f4c8c20f7d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.033563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d9c0e-1180-4866-9261-f2f4c8c20f7d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:13.035805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d9c0e-1180-4866-9261-f2f4c8c20f7d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:13.060135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 422/866] 10.222.0.23 () {60 vars in 1166 bytes} [Wed Aug 25 01:16:13 2021] POST /identity/v3/endpoints => generated 349 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:13.107591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f494f6-df7f-4089-a7b0-4b95bd2f4169 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.107887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f494f6-df7f-4089-a7b0-4b95bd2f4169 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.108056 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f494f6-df7f-4089-a7b0-4b95bd2f4169 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.109812 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 445/867] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:13.117007 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f1e29-1f2b-45f8-b9f7-47dd4d54f1df None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.117314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f1e29-1f2b-45f8-b9f7-47dd4d54f1df None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.117564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f1e29-1f2b-45f8-b9f7-47dd4d54f1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.136306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-f32f1e29-1f2b-45f8-b9f7-47dd4d54f1df None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:13.137534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f32f1e29-1f2b-45f8-b9f7-47dd4d54f1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:13.155594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 423/868] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:13 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:13.180481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f494f6-df7f-4089-a7b0-4b95bd2f4169 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:13.193544 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f494f6-df7f-4089-a7b0-4b95bd2f4169 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:13.198308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e06fb-6c0f-4eee-adc0-7f2736254ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:13.199143 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e06fb-6c0f-4eee-adc0-7f2736254ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.199421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e06fb-6c0f-4eee-adc0-7f2736254ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.199694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e06fb-6c0f-4eee-adc0-7f2736254ee3 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.200354 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e06fb-6c0f-4eee-adc0-7f2736254ee3 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:13.201961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e06fb-6c0f-4eee-adc0-7f2736254ee3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:13.214238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-912e06fb-6c0f-4eee-adc0-7f2736254ee3 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 01:16:13.215831 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 446/869] 10.222.0.23 () {56 vars in 1127 bytes} [Wed Aug 25 01:16:13 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:13.223545 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f1e29-1f2b-45f8-b9f7-47dd4d54f1df None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:13.233235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f1e29-1f2b-45f8-b9f7-47dd4d54f1df None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:13.237892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdab8ce-be5f-4f05-840f-294dabcd2e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:13.238558 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdab8ce-be5f-4f05-840f-294dabcd2e2d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.238881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdab8ce-be5f-4f05-840f-294dabcd2e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.239156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdab8ce-be5f-4f05-840f-294dabcd2e2d admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.239862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdab8ce-be5f-4f05-840f-294dabcd2e2d admin admin] RBAC: Adding query filter params (name=image) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:13.240189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdab8ce-be5f-4f05-840f-294dabcd2e2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:13.241761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdab8ce-be5f-4f05-840f-294dabcd2e2d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:13.252141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 424/870] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:13 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:13.253226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e06fb-6c0f-4eee-adc0-7f2736254ee3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:13.263879 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e06fb-6c0f-4eee-adc0-7f2736254ee3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:13.268612 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a24e81-a3b3-4748-9405-2323469d3519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:13.269799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24e81-a3b3-4748-9405-2323469d3519 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.270081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24e81-a3b3-4748-9405-2323469d3519 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.270368 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24e81-a3b3-4748-9405-2323469d3519 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.271103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24e81-a3b3-4748-9405-2323469d3519 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:13.271408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24e81-a3b3-4748-9405-2323469d3519 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:13.273046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24e81-a3b3-4748-9405-2323469d3519 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:13.278343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 447/871] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:13 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:13.564822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88297f3e-89dc-48f9-96b9-13f31d042410 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.565181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88297f3e-89dc-48f9-96b9-13f31d042410 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.565377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88297f3e-89dc-48f9-96b9-13f31d042410 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.568030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 425/872] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:13.574713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0291b5-8523-4609-9bcf-c330b3326817 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.575006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0291b5-8523-4609-9bcf-c330b3326817 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.575281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0291b5-8523-4609-9bcf-c330b3326817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.593925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-cb0291b5-8523-4609-9bcf-c330b3326817 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:13.595145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cb0291b5-8523-4609-9bcf-c330b3326817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:13.606783 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 448/873] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:13 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:13.627160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88297f3e-89dc-48f9-96b9-13f31d042410 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:13.636659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec886-00c5-4a8d-be12-d0df1bb3fa70 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.637201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec886-00c5-4a8d-be12-d0df1bb3fa70 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.637665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec886-00c5-4a8d-be12-d0df1bb3fa70 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.639892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 449/874] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:13.640664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88297f3e-89dc-48f9-96b9-13f31d042410 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:13.645940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:13.646580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f40f8-dda6-49d2-999c-68ab3ecfe715 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.646718 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.647045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.647366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f40f8-dda6-49d2-999c-68ab3ecfe715 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.647492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.647948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f40f8-dda6-49d2-999c-68ab3ecfe715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.648204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:13.650110 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:13.651637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.common [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 25 01:16:13.666703 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6b6f40f8-dda6-49d2-999c-68ab3ecfe715 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:13.668186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6b6f40f8-dda6-49d2-999c-68ab3ecfe715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:13.674274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.sql.core [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 01:16:13.674274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 25 01:16:13.674274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [parameters: {'id': 'fb5c99cc7dfe4c2ba09cbf4475ce766a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 25 01:16:13.674274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 01:16:13.677909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 450/875] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:13 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:13.691362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb5c99cc7dfe4c2ba09cbf4475ce766a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb5c99cc7dfe4c2ba09cbf4475ce766a. Aug 25 01:16:13.697827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 426/876] 10.222.0.23 () {60 vars in 1162 bytes} [Wed Aug 25 01:16:13 2021] POST /identity/v3/projects => generated 262 bytes in 66 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:13.699812 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f40f8-dda6-49d2-999c-68ab3ecfe715 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:13.709160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:13.713084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f40f8-dda6-49d2-999c-68ab3ecfe715 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:13.718237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7803c-e850-4cbb-a883-044707da5ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:13.718845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7803c-e850-4cbb-a883-044707da5ffe admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.719131 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7803c-e850-4cbb-a883-044707da5ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.719409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7803c-e850-4cbb-a883-044707da5ffe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.722899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ba7ba-81b3-4006-9461-5a067cdde10b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:13.727411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7803c-e850-4cbb-a883-044707da5ffe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:13.728090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17b48c-1a73-4b8e-a4e6-810923198183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:13.728994 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17b48c-1a73-4b8e-a4e6-810923198183 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.729402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7803c-e850-4cbb-a883-044707da5ffe admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:13.729772 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17b48c-1a73-4b8e-a4e6-810923198183 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.730286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17b48c-1a73-4b8e-a4e6-810923198183 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.731265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17b48c-1a73-4b8e-a4e6-810923198183 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:13.733340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17b48c-1a73-4b8e-a4e6-810923198183 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:13.743312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-9db7803c-e850-4cbb-a883-044707da5ffe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:16:13.744640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 451/877] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:13.751016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7803c-e850-4cbb-a883-044707da5ffe admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:13.756207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 427/878] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:16:13 2021] POST /identity/v3/services => generated 242 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:13.767088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7803c-e850-4cbb-a883-044707da5ffe admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:13.786884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095a5ef-7bd1-4aab-9d06-5a87ca072efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:13.788161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095a5ef-7bd1-4aab-9d06-5a87ca072efa admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:13.788769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095a5ef-7bd1-4aab-9d06-5a87ca072efa admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:13.789245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095a5ef-7bd1-4aab-9d06-5a87ca072efa admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:13.790296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095a5ef-7bd1-4aab-9d06-5a87ca072efa admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:13.790952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095a5ef-7bd1-4aab-9d06-5a87ca072efa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:13.793269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095a5ef-7bd1-4aab-9d06-5a87ca072efa admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:13.813399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 452/879] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:16:13 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:15.292538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abcca7-b40b-41f9-a215-ae0b841f13a9 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.293581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abcca7-b40b-41f9-a215-ae0b841f13a9 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.294087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abcca7-b40b-41f9-a215-ae0b841f13a9 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.296328 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 428/880] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:15.303371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e80b1e-bc5e-4ccb-82bd-e0069cc9e8be None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.304161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e80b1e-bc5e-4ccb-82bd-e0069cc9e8be None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.304633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e80b1e-bc5e-4ccb-82bd-e0069cc9e8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.323713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-f6e80b1e-bc5e-4ccb-82bd-e0069cc9e8be None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:15.325228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f6e80b1e-bc5e-4ccb-82bd-e0069cc9e8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:15.338775 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 453/881] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:15 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:15.357958 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abcca7-b40b-41f9-a215-ae0b841f13a9 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:15.372209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abcca7-b40b-41f9-a215-ae0b841f13a9 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:15.377454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee9c1-75ec-4a32-9afe-37cdb967b3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:15.379864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee9c1-75ec-4a32-9afe-37cdb967b3cb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.380402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee9c1-75ec-4a32-9afe-37cdb967b3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.380875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee9c1-75ec-4a32-9afe-37cdb967b3cb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.381753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ee9c1-75ec-4a32-9afe-37cdb967b3cb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:15.383655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ee9c1-75ec-4a32-9afe-37cdb967b3cb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:15.396401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-0d7ee9c1-75ec-4a32-9afe-37cdb967b3cb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 01:16:15.402774 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 429/882] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:15 2021] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:15.405533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e80b1e-bc5e-4ccb-82bd-e0069cc9e8be None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:15.415470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e80b1e-bc5e-4ccb-82bd-e0069cc9e8be None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:15.420388 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8e606-7086-414d-b93b-4f6705bdb9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:15.421293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8e606-7086-414d-b93b-4f6705bdb9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.421769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8e606-7086-414d-b93b-4f6705bdb9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.422237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8e606-7086-414d-b93b-4f6705bdb9a5 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.423177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8e606-7086-414d-b93b-4f6705bdb9a5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:15.423710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8e606-7086-414d-b93b-4f6705bdb9a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:15.426070 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8e606-7086-414d-b93b-4f6705bdb9a5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:15.434888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 454/883] 10.222.0.23 () {56 vars in 1144 bytes} [Wed Aug 25 01:16:15 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:15.438609 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee9c1-75ec-4a32-9afe-37cdb967b3cb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:15.444808 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82848dd9-0855-4b9f-93e6-5eab0d3989a9 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.445094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82848dd9-0855-4b9f-93e6-5eab0d3989a9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.445371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82848dd9-0855-4b9f-93e6-5eab0d3989a9 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.447390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 455/884] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:16:15.449903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee9c1-75ec-4a32-9afe-37cdb967b3cb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:15.452870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee78f7f-fa3a-403d-b862-a1dd5fd094f0 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.453151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee78f7f-fa3a-403d-b862-a1dd5fd094f0 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.453431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee78f7f-fa3a-403d-b862-a1dd5fd094f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.455504 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dfff2-8648-4e4b-89d2-40e87dfb364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:15.456908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dfff2-8648-4e4b-89d2-40e87dfb364b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.457387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dfff2-8648-4e4b-89d2-40e87dfb364b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.457867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dfff2-8648-4e4b-89d2-40e87dfb364b admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.458783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dfff2-8648-4e4b-89d2-40e87dfb364b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:15.459283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dfff2-8648-4e4b-89d2-40e87dfb364b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:15.462315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dfff2-8648-4e4b-89d2-40e87dfb364b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:15.473043 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-1ee78f7f-fa3a-403d-b862-a1dd5fd094f0 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:15.473432 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 430/885] 10.222.0.23 () {56 vars in 1144 bytes} [Wed Aug 25 01:16:15 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:15.473555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1ee78f7f-fa3a-403d-b862-a1dd5fd094f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:15.477183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dfff2-8648-4e4b-89d2-40e87dfb364b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:15.481609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 456/886] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:15 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:15.488033 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dfff2-8648-4e4b-89d2-40e87dfb364b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:15.492842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0a115-9511-49d8-a078-2b259c8f853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:15.493875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0a115-9511-49d8-a078-2b259c8f853d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.494384 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0a115-9511-49d8-a078-2b259c8f853d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.494893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0a115-9511-49d8-a078-2b259c8f853d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.495873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0a115-9511-49d8-a078-2b259c8f853d admin admin] RBAC: Adding query filter params (interface=admin, service_id=7991a6e1ebf94c1894c2fd15228d7224, region_id=RegionOne) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:15.496393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0a115-9511-49d8-a078-2b259c8f853d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:15.498220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0a115-9511-49d8-a078-2b259c8f853d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:15.509236 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee78f7f-fa3a-403d-b862-a1dd5fd094f0 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:15.510298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 431/887] 10.222.0.23 () {56 vars in 1271 bytes} [Wed Aug 25 01:16:15 2021] GET /identity/v3/endpoints?service_id=7991a6e1ebf94c1894c2fd15228d7224&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:15.512310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0a115-9511-49d8-a078-2b259c8f853d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:15.515516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee78f7f-fa3a-403d-b862-a1dd5fd094f0 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:15.520869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca470eeb-f686-4b89-9e55-c183cd27dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:15.521605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca470eeb-f686-4b89-9e55-c183cd27dbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.521956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca470eeb-f686-4b89-9e55-c183cd27dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.522307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca470eeb-f686-4b89-9e55-c183cd27dbe1 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.523132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca470eeb-f686-4b89-9e55-c183cd27dbe1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:15.524208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-ca470eeb-f686-4b89-9e55-c183cd27dbe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:16:15.524208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:16:15.524208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:16:15.525191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca470eeb-f686-4b89-9e55-c183cd27dbe1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:15.525638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0a115-9511-49d8-a078-2b259c8f853d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:15.531271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfb79b-0d42-4be5-aa80-2650831c45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:15.531999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfb79b-0d42-4be5-aa80-2650831c45a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.532350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfb79b-0d42-4be5-aa80-2650831c45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.532702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfb79b-0d42-4be5-aa80-2650831c45a3 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.533453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfb79b-0d42-4be5-aa80-2650831c45a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:15.542853 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfb79b-0d42-4be5-aa80-2650831c45a3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:15.543085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 432/888] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:16:15 2021] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:16:15.545052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 457/889] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:16:15 2021] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:16:15.996085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061d20c-d8a0-4048-9b4c-5944e1ac0ade None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:15.996685 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061d20c-d8a0-4048-9b4c-5944e1ac0ade None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:15.997113 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061d20c-d8a0-4048-9b4c-5944e1ac0ade None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:15.999452 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 433/890] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:16.006194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad090c-99c0-4cac-8790-bd5bef0e6d1c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.006768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad090c-99c0-4cac-8790-bd5bef0e6d1c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.007200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad090c-99c0-4cac-8790-bd5bef0e6d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.025410 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-caad090c-99c0-4cac-8790-bd5bef0e6d1c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:16.026849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-caad090c-99c0-4cac-8790-bd5bef0e6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:16.044376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 458/891] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:16 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:16.056235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9be5-78f9-4602-af2a-dd5902f20a32 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.056532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9be5-78f9-4602-af2a-dd5902f20a32 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.056815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9be5-78f9-4602-af2a-dd5902f20a32 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.058835 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 434/892] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:16.064490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0dfb8-ece5-4c59-81f5-c1f15fce0cbb None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.064892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0dfb8-ece5-4c59-81f5-c1f15fce0cbb None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.065275 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0dfb8-ece5-4c59-81f5-c1f15fce0cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.075823 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e9be5-78f9-4602-af2a-dd5902f20a32 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:16.084356 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e4c0dfb8-ece5-4c59-81f5-c1f15fce0cbb None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:16.086695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e4c0dfb8-ece5-4c59-81f5-c1f15fce0cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:16.092047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e9be5-78f9-4602-af2a-dd5902f20a32 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:16.100283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58f192-fcd9-4779-a718-d87f553ab864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:16.106272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 459/893] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:16 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:16.106413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58f192-fcd9-4779-a718-d87f553ab864 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.106413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58f192-fcd9-4779-a718-d87f553ab864 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.106413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58f192-fcd9-4779-a718-d87f553ab864 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.106413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58f192-fcd9-4779-a718-d87f553ab864 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:16.106413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58f192-fcd9-4779-a718-d87f553ab864 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:16.117857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-1a58f192-fcd9-4779-a718-d87f553ab864 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 01:16:16.119362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 435/894] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:16 2021] GET /identity/v3/services/compute => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:16.127781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0dfb8-ece5-4c59-81f5-c1f15fce0cbb None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:16.133599 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58f192-fcd9-4779-a718-d87f553ab864 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:16.141013 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0dfb8-ece5-4c59-81f5-c1f15fce0cbb None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:16.146428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58f192-fcd9-4779-a718-d87f553ab864 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:16.146965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625a15-3fe3-48ea-98d7-b1a621acbb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:16.148131 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625a15-3fe3-48ea-98d7-b1a621acbb8c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.148657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625a15-3fe3-48ea-98d7-b1a621acbb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.149227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625a15-3fe3-48ea-98d7-b1a621acbb8c admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.150279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51625a15-3fe3-48ea-98d7-b1a621acbb8c admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:16.150851 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51625a15-3fe3-48ea-98d7-b1a621acbb8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:16.151969 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764f175-6c10-4ed4-8d4a-eacdbc372910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:16.152715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764f175-6c10-4ed4-8d4a-eacdbc372910 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.153101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764f175-6c10-4ed4-8d4a-eacdbc372910 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.153353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51625a15-3fe3-48ea-98d7-b1a621acbb8c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:16.153563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764f175-6c10-4ed4-8d4a-eacdbc372910 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.154360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764f175-6c10-4ed4-8d4a-eacdbc372910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:16.156878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764f175-6c10-4ed4-8d4a-eacdbc372910 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:16.160112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 460/895] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:16:16 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:16.166555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625a15-3fe3-48ea-98d7-b1a621acbb8c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:16.171767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.sql.core [None req-9764f175-6c10-4ed4-8d4a-eacdbc372910 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 01:16:16.171767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 25 01:16:16.171767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [parameters: {'user_id': 'e215082aaf00477681174c525c6bb37c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 25 01:16:16.171767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 01:16:16.179284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51625a15-3fe3-48ea-98d7-b1a621acbb8c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:16.180283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-9764f175-6c10-4ed4-8d4a-eacdbc372910 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 25 01:16:16.181967 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 436/896] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:16:16 2021] POST /identity/v3/users => generated 160 bytes in 49 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:16.184665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5cefb-d871-4b69-959f-e7496307c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:16.185532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5cefb-d871-4b69-959f-e7496307c3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.185986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5cefb-d871-4b69-959f-e7496307c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.186474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5cefb-d871-4b69-959f-e7496307c3e4 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.187350 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5cefb-d871-4b69-959f-e7496307c3e4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:16.187824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5cefb-d871-4b69-959f-e7496307c3e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:16.188789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764f175-6c10-4ed4-8d4a-eacdbc372910 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:16.190016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5cefb-d871-4b69-959f-e7496307c3e4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:16.197248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 461/897] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:16:16 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:16.202055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764f175-6c10-4ed4-8d4a-eacdbc372910 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:16.204380 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5cefb-d871-4b69-959f-e7496307c3e4 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:16.207440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e31272-20ae-44b9-a66d-7203582a571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:16.208366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e31272-20ae-44b9-a66d-7203582a571c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.208800 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e31272-20ae-44b9-a66d-7203582a571c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.209213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e31272-20ae-44b9-a66d-7203582a571c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.215647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5cefb-d871-4b69-959f-e7496307c3e4 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:16.219127 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e31272-20ae-44b9-a66d-7203582a571c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:16.220585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec9d82-83c0-41b7-8c41-aed151c13f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:16.221373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9d82-83c0-41b7-8c41-aed151c13f81 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.221769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e31272-20ae-44b9-a66d-7203582a571c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:16.221962 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9d82-83c0-41b7-8c41-aed151c13f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.222918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9d82-83c0-41b7-8c41-aed151c13f81 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.224208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec9d82-83c0-41b7-8c41-aed151c13f81 admin admin] RBAC: Adding query filter params (interface=public, service_id=77fe14e60e5442be9be0b0f5d95d510d, region_id=RegionOne) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:16.224688 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec9d82-83c0-41b7-8c41-aed151c13f81 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:16.226401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec9d82-83c0-41b7-8c41-aed151c13f81 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:16.232331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 462/898] 10.222.0.23 () {56 vars in 1273 bytes} [Wed Aug 25 01:16:16 2021] GET /identity/v3/endpoints?service_id=77fe14e60e5442be9be0b0f5d95d510d&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:16.238198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-a5e31272-20ae-44b9-a66d-7203582a571c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 01:16:16.239121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec9d82-83c0-41b7-8c41-aed151c13f81 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:16.239988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 437/899] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:16:16 2021] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:16.247116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e31272-20ae-44b9-a66d-7203582a571c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:16.250032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec9d82-83c0-41b7-8c41-aed151c13f81 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:16.255589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cab9f3-014e-498e-87ff-dc74587bccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:16.256518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cab9f3-014e-498e-87ff-dc74587bccf6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.256948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cab9f3-014e-498e-87ff-dc74587bccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.257370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cab9f3-014e-498e-87ff-dc74587bccf6 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.258243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cab9f3-014e-498e-87ff-dc74587bccf6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:16.258925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e31272-20ae-44b9-a66d-7203582a571c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:16.260565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cab9f3-014e-498e-87ff-dc74587bccf6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:16.264524 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16715791-c501-495d-943c-40e943d6eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:16.265570 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16715791-c501-495d-943c-40e943d6eac6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:16.265959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16715791-c501-495d-943c-40e943d6eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:16.266341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16715791-c501-495d-943c-40e943d6eac6 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:16.267286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16715791-c501-495d-943c-40e943d6eac6 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:16.267694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16715791-c501-495d-943c-40e943d6eac6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:16.269761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16715791-c501-495d-943c-40e943d6eac6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:16.282793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 463/900] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:16:16 2021] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:16:16.313134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 438/901] 10.222.0.23 () {56 vars in 1123 bytes} [Wed Aug 25 01:16:16 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:17.718868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb857-1afe-4a55-aa12-b59819d878cf None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.719453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb857-1afe-4a55-aa12-b59819d878cf None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.719453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb857-1afe-4a55-aa12-b59819d878cf None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.721220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 464/902] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:17.727480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ad3d-69d3-471f-9ab5-0093ed499c49 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.727919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ad3d-69d3-471f-9ab5-0093ed499c49 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.728096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ad3d-69d3-471f-9ab5-0093ed499c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.746032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-3c52ad3d-69d3-471f-9ab5-0093ed499c49 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:17.747541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3c52ad3d-69d3-471f-9ab5-0093ed499c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:17.756381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 439/903] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:17 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:17.768999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82190c-09eb-4247-b51c-1378d7e0edb6 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.769536 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82190c-09eb-4247-b51c-1378d7e0edb6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.770024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82190c-09eb-4247-b51c-1378d7e0edb6 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.772276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 465/904] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:17.777664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61155794-9a90-409d-a862-b38e8a7e303d None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.777960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61155794-9a90-409d-a862-b38e8a7e303d None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.778245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61155794-9a90-409d-a862-b38e8a7e303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.780005 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82190c-09eb-4247-b51c-1378d7e0edb6 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:17.791732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82190c-09eb-4247-b51c-1378d7e0edb6 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:17.795635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-61155794-9a90-409d-a862-b38e8a7e303d None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:17.795973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ea13-3b2f-4137-b58b-f2933c56485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:17.796743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ea13-3b2f-4137-b58b-f2933c56485d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.796845 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-61155794-9a90-409d-a862-b38e8a7e303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:17.797020 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ea13-3b2f-4137-b58b-f2933c56485d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.797285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ea13-3b2f-4137-b58b-f2933c56485d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.797921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66ea13-3b2f-4137-b58b-f2933c56485d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:17.799527 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66ea13-3b2f-4137-b58b-f2933c56485d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:17.805142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 440/905] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:17 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:17.811038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-bf66ea13-3b2f-4137-b58b-f2933c56485d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 01:16:17.814712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 466/906] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Aug 25 01:16:17 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:17.819522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61155794-9a90-409d-a862-b38e8a7e303d None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:17.828586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61155794-9a90-409d-a862-b38e8a7e303d None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:17.829477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ea13-3b2f-4137-b58b-f2933c56485d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:17.833065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9413f9-7b87-4cf3-aa8c-5975a50ab9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:17.833712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9413f9-7b87-4cf3-aa8c-5975a50ab9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.833991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9413f9-7b87-4cf3-aa8c-5975a50ab9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.834263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9413f9-7b87-4cf3-aa8c-5975a50ab9b6 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.834997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9413f9-7b87-4cf3-aa8c-5975a50ab9b6 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:17.835300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9413f9-7b87-4cf3-aa8c-5975a50ab9b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:17.836896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9413f9-7b87-4cf3-aa8c-5975a50ab9b6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:17.839440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ea13-3b2f-4137-b58b-f2933c56485d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:17.847303 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 441/907] 10.222.0.23 () {56 vars in 1144 bytes} [Wed Aug 25 01:16:17 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:17.848010 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9413f9-7b87-4cf3-aa8c-5975a50ab9b6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:17.848849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b5b4f-f0bb-4b19-87e0-5e7f0074b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:17.849637 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b5b4f-f0bb-4b19-87e0-5e7f0074b392 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.849924 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b5b4f-f0bb-4b19-87e0-5e7f0074b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.850204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b5b4f-f0bb-4b19-87e0-5e7f0074b392 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.850882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b5b4f-f0bb-4b19-87e0-5e7f0074b392 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:17.852506 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b5b4f-f0bb-4b19-87e0-5e7f0074b392 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:17.856967 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9413f9-7b87-4cf3-aa8c-5975a50ab9b6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:17.861250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d65e5-732f-4ea4-868a-0788ee89cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:17.861875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d65e5-732f-4ea4-868a-0788ee89cb29 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.862154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d65e5-732f-4ea4-868a-0788ee89cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.862448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d65e5-732f-4ea4-868a-0788ee89cb29 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.863710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d65e5-732f-4ea4-868a-0788ee89cb29 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:17.864014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d65e5-732f-4ea4-868a-0788ee89cb29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:17.864203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-952b5b4f-f0bb-4b19-87e0-5e7f0074b392 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 01:16:17.865511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 467/908] 10.222.0.23 () {56 vars in 1127 bytes} [Wed Aug 25 01:16:17 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:17.865681 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d65e5-732f-4ea4-868a-0788ee89cb29 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:17.870597 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 442/909] 10.222.0.23 () {56 vars in 1144 bytes} [Wed Aug 25 01:16:17 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:17.875859 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b5b4f-f0bb-4b19-87e0-5e7f0074b392 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:17.876610 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d65e5-732f-4ea4-868a-0788ee89cb29 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:17.882588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b5b4f-f0bb-4b19-87e0-5e7f0074b392 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:17.886395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d65e5-732f-4ea4-868a-0788ee89cb29 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:17.888163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49494f-bcee-4c9f-aa87-0acd3693d641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:17.889052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49494f-bcee-4c9f-aa87-0acd3693d641 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.889338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49494f-bcee-4c9f-aa87-0acd3693d641 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.889644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49494f-bcee-4c9f-aa87-0acd3693d641 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.890315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49494f-bcee-4c9f-aa87-0acd3693d641 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:17.890625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49494f-bcee-4c9f-aa87-0acd3693d641 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:17.891121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaee7d-e22b-445b-8088-654b7f20bd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:17.891739 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaee7d-e22b-445b-8088-654b7f20bd49 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.892135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaee7d-e22b-445b-8088-654b7f20bd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.892293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49494f-bcee-4c9f-aa87-0acd3693d641 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:17.892440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaee7d-e22b-445b-8088-654b7f20bd49 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.893235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceaee7d-e22b-445b-8088-654b7f20bd49 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:17.894705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceaee7d-e22b-445b-8088-654b7f20bd49 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:17.898837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 468/910] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:17 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:17.903799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49494f-bcee-4c9f-aa87-0acd3693d641 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:17.914715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 443/911] 10.222.0.23 () {60 vars in 1166 bytes} [Wed Aug 25 01:16:17 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:17.914887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49494f-bcee-4c9f-aa87-0acd3693d641 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:17.928914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b550e6-a594-49f1-8f8a-19ee675aa24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:17.929591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b550e6-a594-49f1-8f8a-19ee675aa24c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.929887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b550e6-a594-49f1-8f8a-19ee675aa24c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.930147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b550e6-a594-49f1-8f8a-19ee675aa24c admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.930943 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b550e6-a594-49f1-8f8a-19ee675aa24c admin admin] RBAC: Adding query filter params (type=image) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:17.931251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b550e6-a594-49f1-8f8a-19ee675aa24c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:17.932889 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b550e6-a594-49f1-8f8a-19ee675aa24c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:17.938626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 469/912] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:17 2021] GET /identity/v3/services?type=image => generated 350 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:17.945682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaee7d-e22b-445b-8088-654b7f20bd49 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:17.956241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaee7d-e22b-445b-8088-654b7f20bd49 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:17.960999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6bda5-5462-4b84-8ce5-885e5d2c45f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:17.961790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6bda5-5462-4b84-8ce5-885e5d2c45f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.962172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6bda5-5462-4b84-8ce5-885e5d2c45f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.962546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6bda5-5462-4b84-8ce5-885e5d2c45f8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.963506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6bda5-5462-4b84-8ce5-885e5d2c45f8 admin admin] RBAC: Adding query filter params (interface=public, service_id=4da282becbbc48cd9d7afb07d7ca0e7d, region_id=RegionOne) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:17.963919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6bda5-5462-4b84-8ce5-885e5d2c45f8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:17.965642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6bda5-5462-4b84-8ce5-885e5d2c45f8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:17.974721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 444/913] 10.222.0.23 () {56 vars in 1273 bytes} [Wed Aug 25 01:16:17 2021] GET /identity/v3/endpoints?service_id=4da282becbbc48cd9d7afb07d7ca0e7d&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:17.978639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b550e6-a594-49f1-8f8a-19ee675aa24c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:17.989704 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b550e6-a594-49f1-8f8a-19ee675aa24c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:17.994467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77140bfa-7965-41f3-bb7c-949b56fe1e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:17.995297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77140bfa-7965-41f3-bb7c-949b56fe1e55 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:17.995707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77140bfa-7965-41f3-bb7c-949b56fe1e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:17.996083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77140bfa-7965-41f3-bb7c-949b56fe1e55 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:17.996872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77140bfa-7965-41f3-bb7c-949b56fe1e55 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:17.998632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77140bfa-7965-41f3-bb7c-949b56fe1e55 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:18.006819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 470/914] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:16:17 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:16:18.454987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9341-daa4-4390-83a7-3ee68267927a None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:18.455276 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9341-daa4-4390-83a7-3ee68267927a None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:18.455553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9341-daa4-4390-83a7-3ee68267927a None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:18.457839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 445/915] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:16:18.463756 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc35ef-843a-4bd9-8765-b6d88a0995bd None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:18.464052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc35ef-843a-4bd9-8765-b6d88a0995bd None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:18.464333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc35ef-843a-4bd9-8765-b6d88a0995bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:18.482139 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e0bc35ef-843a-4bd9-8765-b6d88a0995bd None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:18.485651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e0bc35ef-843a-4bd9-8765-b6d88a0995bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:18.492857 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 471/916] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:18 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:18.516375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9341-daa4-4390-83a7-3ee68267927a None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:18.528754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9341-daa4-4390-83a7-3ee68267927a None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:18.532976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4c219-0ef0-4eb5-939a-85627abd1d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:18.533748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4c219-0ef0-4eb5-939a-85627abd1d0b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:18.534029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4c219-0ef0-4eb5-939a-85627abd1d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:18.534304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4c219-0ef0-4eb5-939a-85627abd1d0b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:18.535529 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4c219-0ef0-4eb5-939a-85627abd1d0b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:18.537112 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4c219-0ef0-4eb5-939a-85627abd1d0b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:18.547691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-f2b4c219-0ef0-4eb5-939a-85627abd1d0b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 01:16:18.548935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 446/917] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:18 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:18.555149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc35ef-843a-4bd9-8765-b6d88a0995bd None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:18.564050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc35ef-843a-4bd9-8765-b6d88a0995bd None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:18.568513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2c283-c40a-4ab5-81a7-ad2fcfe86939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:18.569162 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2c283-c40a-4ab5-81a7-ad2fcfe86939 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:18.569444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2c283-c40a-4ab5-81a7-ad2fcfe86939 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:18.569721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2c283-c40a-4ab5-81a7-ad2fcfe86939 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:18.570418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2c283-c40a-4ab5-81a7-ad2fcfe86939 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:18.572562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2c283-c40a-4ab5-81a7-ad2fcfe86939 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:18.572562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2c283-c40a-4ab5-81a7-ad2fcfe86939 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:18.577172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 472/918] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:16:18 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:18.583482 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4c219-0ef0-4eb5-939a-85627abd1d0b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:18.592910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4c219-0ef0-4eb5-939a-85627abd1d0b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:18.597951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa599943-5be7-4719-a074-bd793e6d4d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:18.598590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa599943-5be7-4719-a074-bd793e6d4d31 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:18.598957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa599943-5be7-4719-a074-bd793e6d4d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:18.599236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa599943-5be7-4719-a074-bd793e6d4d31 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:18.599931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa599943-5be7-4719-a074-bd793e6d4d31 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:18.600235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa599943-5be7-4719-a074-bd793e6d4d31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:18.601803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa599943-5be7-4719-a074-bd793e6d4d31 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:18.606712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 447/919] 10.222.0.23 () {56 vars in 1134 bytes} [Wed Aug 25 01:16:18 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:18.613010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2c283-c40a-4ab5-81a7-ad2fcfe86939 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:18.622776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2c283-c40a-4ab5-81a7-ad2fcfe86939 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:18.627285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e30d2-1234-4bd4-a1f4-28644bb59454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:18.627997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e30d2-1234-4bd4-a1f4-28644bb59454 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:18.628376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e30d2-1234-4bd4-a1f4-28644bb59454 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:18.628726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e30d2-1234-4bd4-a1f4-28644bb59454 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:18.629529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e30d2-1234-4bd4-a1f4-28644bb59454 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:18.631225 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e30d2-1234-4bd4-a1f4-28644bb59454 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:18.651450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 473/920] 10.222.0.23 () {60 vars in 1166 bytes} [Wed Aug 25 01:16:18 2021] POST /identity/v3/endpoints => generated 334 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:20.120449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fbce7-12ea-4a3e-b98b-46aaba70bc1c None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.120970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fbce7-12ea-4a3e-b98b-46aaba70bc1c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.121047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fbce7-12ea-4a3e-b98b-46aaba70bc1c None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.122965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 448/921] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:20.129442 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2e04c-bfaa-471a-84bc-49c539189ea4 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.129847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2e04c-bfaa-471a-84bc-49c539189ea4 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.130007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2e04c-bfaa-471a-84bc-49c539189ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.147477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-aae2e04c-bfaa-471a-84bc-49c539189ea4 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:20.148655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-aae2e04c-bfaa-471a-84bc-49c539189ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:20.158374 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb70f9-2449-4317-b159-d963a858486d None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.158667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb70f9-2449-4317-b159-d963a858486d None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.158976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb70f9-2449-4317-b159-d963a858486d None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.160876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 449/922] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:16:20.166280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b55a-5d9c-427b-97e3-2888a8914fdc None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.166571 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b55a-5d9c-427b-97e3-2888a8914fdc None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.166885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b55a-5d9c-427b-97e3-2888a8914fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.170827 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 474/923] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:20 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:20.184626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-02c1b55a-5d9c-427b-97e3-2888a8914fdc None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:20.185825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-02c1b55a-5d9c-427b-97e3-2888a8914fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:20.190773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2e04c-bfaa-471a-84bc-49c539189ea4 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:20.195568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 450/924] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:20 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:20.200380 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2e04c-bfaa-471a-84bc-49c539189ea4 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:20.204867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c19c-bc5b-4496-a473-9c8c35d5e577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:20.205658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c19c-bc5b-4496-a473-9c8c35d5e577 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.205941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c19c-bc5b-4496-a473-9c8c35d5e577 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.206242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c19c-bc5b-4496-a473-9c8c35d5e577 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.207443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279c19c-bc5b-4496-a473-9c8c35d5e577 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:20.209125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279c19c-bc5b-4496-a473-9c8c35d5e577 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:20.210824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 475/925] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:20.217189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b55a-5d9c-427b-97e3-2888a8914fdc None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:20.218232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c19c-bc5b-4496-a473-9c8c35d5e577 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:20.227788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c19c-bc5b-4496-a473-9c8c35d5e577 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:20.228069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b55a-5d9c-427b-97e3-2888a8914fdc None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:20.232316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79498d-88c9-414a-804a-4629ad22bde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:20.232843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c80d30-fdcd-435e-86de-a4c9015e8bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:20.233069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79498d-88c9-414a-804a-4629ad22bde3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.233355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79498d-88c9-414a-804a-4629ad22bde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.233517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c80d30-fdcd-435e-86de-a4c9015e8bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.233625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79498d-88c9-414a-804a-4629ad22bde3 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.233776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c80d30-fdcd-435e-86de-a4c9015e8bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.234023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c80d30-fdcd-435e-86de-a4c9015e8bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.234267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79498d-88c9-414a-804a-4629ad22bde3 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:20.234744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c80d30-fdcd-435e-86de-a4c9015e8bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:20.235870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79498d-88c9-414a-804a-4629ad22bde3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:20.236629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c80d30-fdcd-435e-86de-a4c9015e8bd9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:20.247114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-2d79498d-88c9-414a-804a-4629ad22bde3 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 01:16:20.248439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 476/926] 10.222.0.23 () {56 vars in 1127 bytes} [Wed Aug 25 01:16:20 2021] GET /identity/v3/services/image => generated 86 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:20.255679 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79498d-88c9-414a-804a-4629ad22bde3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:20.265842 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79498d-88c9-414a-804a-4629ad22bde3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:20.270843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 451/927] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:16:20 2021] POST /identity/v3/projects => generated 311 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:20.335297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5ec92-950f-4b6b-84e1-d8490e673cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:20.335978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5ec92-950f-4b6b-84e1-d8490e673cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.336263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5ec92-950f-4b6b-84e1-d8490e673cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.336540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5ec92-950f-4b6b-84e1-d8490e673cd1 admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.337253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5ec92-950f-4b6b-84e1-d8490e673cd1 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:20.337566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5ec92-950f-4b6b-84e1-d8490e673cd1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:20.339663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5ec92-950f-4b6b-84e1-d8490e673cd1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:20.350963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 477/928] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:20 2021] GET /identity/v3/services?name=image => generated 122 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:20.352225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c80d30-fdcd-435e-86de-a4c9015e8bd9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:20.363114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c80d30-fdcd-435e-86de-a4c9015e8bd9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:20.367760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebedcf5-c3aa-4211-9f93-4d0ea04091f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:20.368431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebedcf5-c3aa-4211-9f93-4d0ea04091f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.368714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebedcf5-c3aa-4211-9f93-4d0ea04091f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.368980 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebedcf5-c3aa-4211-9f93-4d0ea04091f7 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.369712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebedcf5-c3aa-4211-9f93-4d0ea04091f7 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:20.370013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebedcf5-c3aa-4211-9f93-4d0ea04091f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:20.371719 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebedcf5-c3aa-4211-9f93-4d0ea04091f7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:20.377220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 452/929] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:20 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:20.383965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5ec92-950f-4b6b-84e1-d8490e673cd1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:20.394589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5ec92-950f-4b6b-84e1-d8490e673cd1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:20.399392 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf6355-2e9b-4df0-8c79-75d4e2bca189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:20.400061 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6355-2e9b-4df0-8c79-75d4e2bca189 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.400346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6355-2e9b-4df0-8c79-75d4e2bca189 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.400627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6355-2e9b-4df0-8c79-75d4e2bca189 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.401371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf6355-2e9b-4df0-8c79-75d4e2bca189 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:20.403030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf6355-2e9b-4df0-8c79-75d4e2bca189 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:20.423356 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 478/930] 10.222.0.23 () {60 vars in 1166 bytes} [Wed Aug 25 01:16:20 2021] POST /identity/v3/endpoints => generated 327 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:20.905521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70e02-7155-4652-8920-a27d60ddc332 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.905807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70e02-7155-4652-8920-a27d60ddc332 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.906091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70e02-7155-4652-8920-a27d60ddc332 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.908031 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 453/931] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:20.914303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb19d8-f242-4e19-9fb1-9f30cb0c8010 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.914598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb19d8-f242-4e19-9fb1-9f30cb0c8010 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.914916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb19d8-f242-4e19-9fb1-9f30cb0c8010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:20.932227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c5cb19d8-f242-4e19-9fb1-9f30cb0c8010 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:20.933422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c5cb19d8-f242-4e19-9fb1-9f30cb0c8010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:20.949970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 479/932] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:20.974925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70e02-7155-4652-8920-a27d60ddc332 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:20.986901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70e02-7155-4652-8920-a27d60ddc332 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:20.991295 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d49d0d-487c-4191-8bb4-63100e01083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:20.992084 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d49d0d-487c-4191-8bb4-63100e01083e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:20.992367 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d49d0d-487c-4191-8bb4-63100e01083e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:20.992643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d49d0d-487c-4191-8bb4-63100e01083e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.003026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d49d0d-487c-4191-8bb4-63100e01083e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:21.010218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-a5d49d0d-487c-4191-8bb4-63100e01083e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 01:16:21.011538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 454/933] 10.222.0.23 () {56 vars in 1142 bytes} [Wed Aug 25 01:16:20 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:21.018272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb19d8-f242-4e19-9fb1-9f30cb0c8010 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.027903 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb19d8-f242-4e19-9fb1-9f30cb0c8010 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.032817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d44a6-2a80-483a-82cb-491abb816042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.033479 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d44a6-2a80-483a-82cb-491abb816042 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.033776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d44a6-2a80-483a-82cb-491abb816042 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.034050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d44a6-2a80-483a-82cb-491abb816042 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.035480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d44a6-2a80-483a-82cb-491abb816042 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:21.035793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d44a6-2a80-483a-82cb-491abb816042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.037408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d44a6-2a80-483a-82cb-491abb816042 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.045691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 480/934] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:21.052032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d49d0d-487c-4191-8bb4-63100e01083e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.061763 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d49d0d-487c-4191-8bb4-63100e01083e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.066974 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80c5e-2773-49a2-b7a7-cd6608c72eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.067851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80c5e-2773-49a2-b7a7-cd6608c72eac admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.068242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80c5e-2773-49a2-b7a7-cd6608c72eac admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.068617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80c5e-2773-49a2-b7a7-cd6608c72eac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.078652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a80c5e-2773-49a2-b7a7-cd6608c72eac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.080638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a80c5e-2773-49a2-b7a7-cd6608c72eac admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.097698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-b6a80c5e-2773-49a2-b7a7-cd6608c72eac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:21.102733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 455/935] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:16:21.105673 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d44a6-2a80-483a-82cb-491abb816042 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.115515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d44a6-2a80-483a-82cb-491abb816042 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.120175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ce88-a551-48fc-ba80-007f3261cc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.120823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ce88-a551-48fc-ba80-007f3261cc5f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.121113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ce88-a551-48fc-ba80-007f3261cc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.121390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ce88-a551-48fc-ba80-007f3261cc5f admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.122113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ce88-a551-48fc-ba80-007f3261cc5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:21.122422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ce88-a551-48fc-ba80-007f3261cc5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.124053 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ce88-a551-48fc-ba80-007f3261cc5f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.137017 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 481/936] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:21.143414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80c5e-2773-49a2-b7a7-cd6608c72eac admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.153693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80c5e-2773-49a2-b7a7-cd6608c72eac admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.158518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e904d-55be-4947-9bdf-9920fda387b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.159354 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e904d-55be-4947-9bdf-9920fda387b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.159639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e904d-55be-4947-9bdf-9920fda387b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.159917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e904d-55be-4947-9bdf-9920fda387b6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.167192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e904d-55be-4947-9bdf-9920fda387b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.169215 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e904d-55be-4947-9bdf-9920fda387b6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.182834 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-284e904d-55be-4947-9bdf-9920fda387b6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 01:16:21.184189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 456/937] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:21.190378 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ce88-a551-48fc-ba80-007f3261cc5f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.200630 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ce88-a551-48fc-ba80-007f3261cc5f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.205139 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87aa8e5-f433-4c21-a894-fda5a91e36c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.205802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aa8e5-f433-4c21-a894-fda5a91e36c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.206087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aa8e5-f433-4c21-a894-fda5a91e36c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.207036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aa8e5-f433-4c21-a894-fda5a91e36c2 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.207937 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87aa8e5-f433-4c21-a894-fda5a91e36c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:21.208252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87aa8e5-f433-4c21-a894-fda5a91e36c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.210110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87aa8e5-f433-4c21-a894-fda5a91e36c2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.227701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 482/938] 10.222.0.23 () {56 vars in 1155 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:21.233726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e904d-55be-4947-9bdf-9920fda387b6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.243447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e904d-55be-4947-9bdf-9920fda387b6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.247940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4790d-8171-4c67-be60-5a4ef7cf6e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.248575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4790d-8171-4c67-be60-5a4ef7cf6e6e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.248862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4790d-8171-4c67-be60-5a4ef7cf6e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.249141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4790d-8171-4c67-be60-5a4ef7cf6e6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.257451 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4790d-8171-4c67-be60-5a4ef7cf6e6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.259228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4790d-8171-4c67-be60-5a4ef7cf6e6e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.268304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 457/939] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:16:21.275574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87aa8e5-f433-4c21-a894-fda5a91e36c2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.285195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87aa8e5-f433-4c21-a894-fda5a91e36c2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.289611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424956d-9d22-4540-9f7a-765af80d69ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.290392 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424956d-9d22-4540-9f7a-765af80d69ad admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.290672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424956d-9d22-4540-9f7a-765af80d69ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.290974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424956d-9d22-4540-9f7a-765af80d69ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.300911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424956d-9d22-4540-9f7a-765af80d69ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.302786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424956d-9d22-4540-9f7a-765af80d69ad admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.320772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-5424956d-9d22-4540-9f7a-765af80d69ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:21.322162 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 483/940] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:21.328130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4790d-8171-4c67-be60-5a4ef7cf6e6e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.337380 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4790d-8171-4c67-be60-5a4ef7cf6e6e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.342156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257792b-3a82-4f9e-95ee-56fc4aa10895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.342825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257792b-3a82-4f9e-95ee-56fc4aa10895 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.343108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257792b-3a82-4f9e-95ee-56fc4aa10895 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.343378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257792b-3a82-4f9e-95ee-56fc4aa10895 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.344090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257792b-3a82-4f9e-95ee-56fc4aa10895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:21.344393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257792b-3a82-4f9e-95ee-56fc4aa10895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.345948 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257792b-3a82-4f9e-95ee-56fc4aa10895 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.357472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 458/941] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:21.363346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424956d-9d22-4540-9f7a-765af80d69ad admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.372963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424956d-9d22-4540-9f7a-765af80d69ad admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.377402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19341518-3fdd-4a8c-96ed-7330803cff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.378741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19341518-3fdd-4a8c-96ed-7330803cff4a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.379022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19341518-3fdd-4a8c-96ed-7330803cff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.379297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19341518-3fdd-4a8c-96ed-7330803cff4a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.386125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19341518-3fdd-4a8c-96ed-7330803cff4a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.388156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19341518-3fdd-4a8c-96ed-7330803cff4a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.401630 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-19341518-3fdd-4a8c-96ed-7330803cff4a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:16:21.402994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 484/942] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:21.409221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257792b-3a82-4f9e-95ee-56fc4aa10895 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.418823 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257792b-3a82-4f9e-95ee-56fc4aa10895 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.423492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d322a2f-94c2-4ffd-897e-924ec61a7661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.424209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d322a2f-94c2-4ffd-897e-924ec61a7661 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.424571 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d322a2f-94c2-4ffd-897e-924ec61a7661 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.424938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d322a2f-94c2-4ffd-897e-924ec61a7661 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.425768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d322a2f-94c2-4ffd-897e-924ec61a7661 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:21.426145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d322a2f-94c2-4ffd-897e-924ec61a7661 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.428079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d322a2f-94c2-4ffd-897e-924ec61a7661 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.442737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 459/943] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:21.447209 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19341518-3fdd-4a8c-96ed-7330803cff4a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:21.457939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19341518-3fdd-4a8c-96ed-7330803cff4a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:21.462358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb809af5-013e-4505-9aae-9c6b3daa18ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:21.463018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb809af5-013e-4505-9aae-9c6b3daa18ec admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:21.463299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb809af5-013e-4505-9aae-9c6b3daa18ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:21.463570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb809af5-013e-4505-9aae-9c6b3daa18ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:21.464385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb809af5-013e-4505-9aae-9c6b3daa18ec admin admin] RBAC: Adding query filter params (role.id=1a8543e154214990bd46ec2d9719d019, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=d061cf5060334e79ab4f22518d37116f) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:21.464690 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb809af5-013e-4505-9aae-9c6b3daa18ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:21.466501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb809af5-013e-4505-9aae-9c6b3daa18ec admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:21.472296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 485/944] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:21 2021] GET /identity/v3/role_assignments?user.id=d061cf5060334e79ab4f22518d37116f&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=1a8543e154214990bd46ec2d9719d019 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:22.467800 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1aaa-76ee-40f5-9817-ead32f84e4df None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:22.468352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1aaa-76ee-40f5-9817-ead32f84e4df None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:22.468352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1aaa-76ee-40f5-9817-ead32f84e4df None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:22.470276 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 460/945] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:22.476698 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d38f37-65fe-4ee2-bd73-69b16d30247b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:22.477116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d38f37-65fe-4ee2-bd73-69b16d30247b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:22.477313 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d38f37-65fe-4ee2-bd73-69b16d30247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:22.494857 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-25d38f37-65fe-4ee2-bd73-69b16d30247b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:22.496057 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-25d38f37-65fe-4ee2-bd73-69b16d30247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:22.507761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 486/946] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:22.530017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1aaa-76ee-40f5-9817-ead32f84e4df None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:22.543197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1aaa-76ee-40f5-9817-ead32f84e4df None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:22.547713 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f7dca-e454-45d5-a8ae-f504cb491aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:22.548521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f7dca-e454-45d5-a8ae-f504cb491aae admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:22.548799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f7dca-e454-45d5-a8ae-f504cb491aae admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:22.549068 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f7dca-e454-45d5-a8ae-f504cb491aae admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:22.550311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f7dca-e454-45d5-a8ae-f504cb491aae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:22.552066 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f7dca-e454-45d5-a8ae-f504cb491aae admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:22.553931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 461/947] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:22.560431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d38f37-65fe-4ee2-bd73-69b16d30247b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:22.570317 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d38f37-65fe-4ee2-bd73-69b16d30247b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:22.574814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58381d-1df0-43b5-b7d0-a0516713a64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:22.575486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58381d-1df0-43b5-b7d0-a0516713a64f admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:22.575767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58381d-1df0-43b5-b7d0-a0516713a64f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:22.576037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58381d-1df0-43b5-b7d0-a0516713a64f admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:22.576741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58381d-1df0-43b5-b7d0-a0516713a64f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:22.578641 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58381d-1df0-43b5-b7d0-a0516713a64f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:22.598949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 487/948] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:16:22 2021] POST /identity/v3/users => generated 285 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:22.621921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a92bd-a5a0-434d-a95a-ae7712035370 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:22.622207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a92bd-a5a0-434d-a95a-ae7712035370 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:22.622487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a92bd-a5a0-434d-a95a-ae7712035370 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:22.624603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 462/949] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:22.631923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292360-3fb7-4d4e-b935-6b3a5f9c4d0b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:22.632268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292360-3fb7-4d4e-b935-6b3a5f9c4d0b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:22.632501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292360-3fb7-4d4e-b935-6b3a5f9c4d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:22.651976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7b292360-3fb7-4d4e-b935-6b3a5f9c4d0b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:22.653212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7b292360-3fb7-4d4e-b935-6b3a5f9c4d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:22.661499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 488/950] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:22.685242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a92bd-a5a0-434d-a95a-ae7712035370 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:22.698606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a92bd-a5a0-434d-a95a-ae7712035370 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:22.703161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d08cba-ec76-403b-b52d-43e02b0d9c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:22.703817 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d08cba-ec76-403b-b52d-43e02b0d9c6d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:22.704101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d08cba-ec76-403b-b52d-43e02b0d9c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:22.704377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d08cba-ec76-403b-b52d-43e02b0d9c6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:22.713566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d08cba-ec76-403b-b52d-43e02b0d9c6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:22.715375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d08cba-ec76-403b-b52d-43e02b0d9c6d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:22.725774 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 463/951] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:22 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:22.732242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b292360-3fb7-4d4e-b935-6b3a5f9c4d0b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:22.741785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b292360-3fb7-4d4e-b935-6b3a5f9c4d0b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:22.746815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ee04d-c83d-4beb-9c8c-cca01aa553a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:22.747706 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee04d-c83d-4beb-9c8c-cca01aa553a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:22.748059 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee04d-c83d-4beb-9c8c-cca01aa553a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:22.748422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee04d-c83d-4beb-9c8c-cca01aa553a2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:22.749686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ee04d-c83d-4beb-9c8c-cca01aa553a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:22.751567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ee04d-c83d-4beb-9c8c-cca01aa553a2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:22.758705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 489/952] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:23.624676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af004-3d3d-43f1-b403-7682f932c4de None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:23.625189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af004-3d3d-43f1-b403-7682f932c4de None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:23.625272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af004-3d3d-43f1-b403-7682f932c4de None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:23.627026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 464/953] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:23.632917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6347-963d-427d-86fb-7ee1780d41bd None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:23.633315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6347-963d-427d-86fb-7ee1780d41bd None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:23.633467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6347-963d-427d-86fb-7ee1780d41bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:23.650844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e03f6347-963d-427d-86fb-7ee1780d41bd None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:23.652027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e03f6347-963d-427d-86fb-7ee1780d41bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:23.660078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 490/954] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:23.684013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0af004-3d3d-43f1-b403-7682f932c4de None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:23.695975 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0af004-3d3d-43f1-b403-7682f932c4de None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:23.700313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b3cee-7652-4226-a683-c8f0af5dbdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:23.701101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b3cee-7652-4226-a683-c8f0af5dbdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:23.701400 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b3cee-7652-4226-a683-c8f0af5dbdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:23.701657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b3cee-7652-4226-a683-c8f0af5dbdc1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:23.712186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b3cee-7652-4226-a683-c8f0af5dbdc1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:23.719358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-518b3cee-7652-4226-a683-c8f0af5dbdc1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 01:16:23.720684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 465/955] 10.222.0.23 () {56 vars in 1142 bytes} [Wed Aug 25 01:16:23 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:23.727699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f6347-963d-427d-86fb-7ee1780d41bd None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:23.736624 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f6347-963d-427d-86fb-7ee1780d41bd None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:23.741115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc54bb8-a897-483c-a5b0-adbce5b1aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:23.741763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc54bb8-a897-483c-a5b0-adbce5b1aa91 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:23.742044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc54bb8-a897-483c-a5b0-adbce5b1aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:23.742314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc54bb8-a897-483c-a5b0-adbce5b1aa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:23.743075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc54bb8-a897-483c-a5b0-adbce5b1aa91 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:23.743377 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc54bb8-a897-483c-a5b0-adbce5b1aa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:23.744950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc54bb8-a897-483c-a5b0-adbce5b1aa91 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:23.752951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 491/956] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 25 01:16:23 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:23.759339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b3cee-7652-4226-a683-c8f0af5dbdc1 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:23.770074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b3cee-7652-4226-a683-c8f0af5dbdc1 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:23.774561 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab22e2d-b182-415c-a62d-4d759dbac26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:23.775357 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab22e2d-b182-415c-a62d-4d759dbac26d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:23.775642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab22e2d-b182-415c-a62d-4d759dbac26d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:23.775921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab22e2d-b182-415c-a62d-4d759dbac26d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:23.786354 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab22e2d-b182-415c-a62d-4d759dbac26d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:23.788231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab22e2d-b182-415c-a62d-4d759dbac26d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:23.805762 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-2ab22e2d-b182-415c-a62d-4d759dbac26d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:23.806935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 466/957] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:23.813146 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc54bb8-a897-483c-a5b0-adbce5b1aa91 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:23.823253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc54bb8-a897-483c-a5b0-adbce5b1aa91 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:23.827948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027ef50-7977-4f3c-b760-96fe8844dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:23.828626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027ef50-7977-4f3c-b760-96fe8844dbee admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:23.828908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027ef50-7977-4f3c-b760-96fe8844dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:23.829184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027ef50-7977-4f3c-b760-96fe8844dbee admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:23.829913 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027ef50-7977-4f3c-b760-96fe8844dbee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:23.830218 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027ef50-7977-4f3c-b760-96fe8844dbee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:23.832358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027ef50-7977-4f3c-b760-96fe8844dbee admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:23.844401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 492/958] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:23.851645 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab22e2d-b182-415c-a62d-4d759dbac26d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:23.861618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab22e2d-b182-415c-a62d-4d759dbac26d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:23.866129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8600ab-b7c5-44d2-9689-656ff0796436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:23.866950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8600ab-b7c5-44d2-9689-656ff0796436 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:23.867236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8600ab-b7c5-44d2-9689-656ff0796436 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:23.867510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8600ab-b7c5-44d2-9689-656ff0796436 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:23.874598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8600ab-b7c5-44d2-9689-656ff0796436 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:23.876640 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8600ab-b7c5-44d2-9689-656ff0796436 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:23.890213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-4b8600ab-b7c5-44d2-9689-656ff0796436 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 01:16:23.891387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 467/959] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 25 01:16:23 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:23.898389 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027ef50-7977-4f3c-b760-96fe8844dbee admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:23.908015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027ef50-7977-4f3c-b760-96fe8844dbee admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:23.913030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120416d-aaf3-420d-b55d-645a32d35331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:23.913683 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120416d-aaf3-420d-b55d-645a32d35331 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:23.913966 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120416d-aaf3-420d-b55d-645a32d35331 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:23.914240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120416d-aaf3-420d-b55d-645a32d35331 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:23.915094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120416d-aaf3-420d-b55d-645a32d35331 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:23.915405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120416d-aaf3-420d-b55d-645a32d35331 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:23.917235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120416d-aaf3-420d-b55d-645a32d35331 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:23.933801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 493/960] 10.222.0.23 () {56 vars in 1155 bytes} [Wed Aug 25 01:16:23 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:23.940182 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8600ab-b7c5-44d2-9689-656ff0796436 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:23.949664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8600ab-b7c5-44d2-9689-656ff0796436 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:23.954080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e227bf-680b-48a7-aeac-c12c84bd1a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:23.954895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e227bf-680b-48a7-aeac-c12c84bd1a94 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:23.955178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e227bf-680b-48a7-aeac-c12c84bd1a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:23.955454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e227bf-680b-48a7-aeac-c12c84bd1a94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:23.965733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e227bf-680b-48a7-aeac-c12c84bd1a94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:23.967578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e227bf-680b-48a7-aeac-c12c84bd1a94 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:23.984440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-c4e227bf-680b-48a7-aeac-c12c84bd1a94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:23.985543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 468/961] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:23.991560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120416d-aaf3-420d-b55d-645a32d35331 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:24.000853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120416d-aaf3-420d-b55d-645a32d35331 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:24.005277 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d9512-276d-4716-aa48-fccdeadd4962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:24.005911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d9512-276d-4716-aa48-fccdeadd4962 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:24.006191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d9512-276d-4716-aa48-fccdeadd4962 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:24.006463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d9512-276d-4716-aa48-fccdeadd4962 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:24.007202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d9512-276d-4716-aa48-fccdeadd4962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:24.007506 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d9512-276d-4716-aa48-fccdeadd4962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:24.009071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d9512-276d-4716-aa48-fccdeadd4962 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:24.021462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 494/962] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:24.026561 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e227bf-680b-48a7-aeac-c12c84bd1a94 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:24.036372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e227bf-680b-48a7-aeac-c12c84bd1a94 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:24.040797 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc87a1f-108e-4c93-90e4-9d6ed20ee075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:24.041552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc87a1f-108e-4c93-90e4-9d6ed20ee075 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:24.041832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc87a1f-108e-4c93-90e4-9d6ed20ee075 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:24.042107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc87a1f-108e-4c93-90e4-9d6ed20ee075 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:24.048705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc87a1f-108e-4c93-90e4-9d6ed20ee075 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:24.050637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc87a1f-108e-4c93-90e4-9d6ed20ee075 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:24.063108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-dcc87a1f-108e-4c93-90e4-9d6ed20ee075 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:16:24.064315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 469/963] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:24.070529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d9512-276d-4716-aa48-fccdeadd4962 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:24.079609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d9512-276d-4716-aa48-fccdeadd4962 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:24.084625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854662b-e99f-4313-868b-939fd98180b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:24.085245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854662b-e99f-4313-868b-939fd98180b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:24.085525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854662b-e99f-4313-868b-939fd98180b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:24.085795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854662b-e99f-4313-868b-939fd98180b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:24.086554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854662b-e99f-4313-868b-939fd98180b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:24.086896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854662b-e99f-4313-868b-939fd98180b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:24.088715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854662b-e99f-4313-868b-939fd98180b7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:24.100448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 495/964] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:16:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:24.106814 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc87a1f-108e-4c93-90e4-9d6ed20ee075 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:24.117023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc87a1f-108e-4c93-90e4-9d6ed20ee075 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:24.121508 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a091ab7-7938-40d3-98be-dc036331522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:24.122366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a091ab7-7938-40d3-98be-dc036331522b admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:24.122645 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a091ab7-7938-40d3-98be-dc036331522b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:24.122959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a091ab7-7938-40d3-98be-dc036331522b admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/d061cf5060334e79ab4f22518d37116f/roles/1a8543e154214990bd46ec2d9719d019` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:24.125114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a091ab7-7938-40d3-98be-dc036331522b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=d061cf5060334e79ab4f22518d37116f, role_id=1a8543e154214990bd46ec2d9719d019)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:24.127771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a091ab7-7938-40d3-98be-dc036331522b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:24.141203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 470/965] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:16:24 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/d061cf5060334e79ab4f22518d37116f/roles/1a8543e154214990bd46ec2d9719d019 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:16:24.807355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293dc45-2c2e-4d50-8901-eb1e7967afb4 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:24.807866 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293dc45-2c2e-4d50-8901-eb1e7967afb4 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:24.807866 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293dc45-2c2e-4d50-8901-eb1e7967afb4 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:24.809606 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 496/966] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:24.816352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b02a-0119-4894-8a61-eafb48f78340 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:24.816767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b02a-0119-4894-8a61-eafb48f78340 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:24.816905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b02a-0119-4894-8a61-eafb48f78340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:24.833673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-bba2b02a-0119-4894-8a61-eafb48f78340 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:24.834917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-bba2b02a-0119-4894-8a61-eafb48f78340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:24.889721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 471/967] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:24.914545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293dc45-2c2e-4d50-8901-eb1e7967afb4 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:24.927320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293dc45-2c2e-4d50-8901-eb1e7967afb4 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:24.931731 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5045d-5059-4edf-9672-637d19502221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:24.932576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5045d-5059-4edf-9672-637d19502221 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:24.932928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5045d-5059-4edf-9672-637d19502221 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:24.933269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5045d-5059-4edf-9672-637d19502221 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:24.943807 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5045d-5059-4edf-9672-637d19502221 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:24.954044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-d7d5045d-5059-4edf-9672-637d19502221 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:16:24.955253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 497/968] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:16:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:24.962042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2b02a-0119-4894-8a61-eafb48f78340 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:24.970973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2b02a-0119-4894-8a61-eafb48f78340 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:24.975984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7ff4f-c71c-400e-a484-1dc2720a39d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:24.976632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7ff4f-c71c-400e-a484-1dc2720a39d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:24.976914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7ff4f-c71c-400e-a484-1dc2720a39d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:24.977192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7ff4f-c71c-400e-a484-1dc2720a39d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:24.978021 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7ff4f-c71c-400e-a484-1dc2720a39d7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:24.978238 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7ff4f-c71c-400e-a484-1dc2720a39d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:24.979848 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7ff4f-c71c-400e-a484-1dc2720a39d7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:24.988762 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 472/969] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:16:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:24.994868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5045d-5059-4edf-9672-637d19502221 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:25.004891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5045d-5059-4edf-9672-637d19502221 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:25.009390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00787af-26ff-421a-87e1-42ac9aa8e2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:25.010316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00787af-26ff-421a-87e1-42ac9aa8e2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:25.010660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00787af-26ff-421a-87e1-42ac9aa8e2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:25.010964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00787af-26ff-421a-87e1-42ac9aa8e2e8 admin admin] PATH_INFO: `/v3/users/f1ee6a2a566f4aeb8fbdab9bb3ed1a3c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:25.023728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00787af-26ff-421a-87e1-42ac9aa8e2e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=f1ee6a2a566f4aeb8fbdab9bb3ed1a3c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:25.025861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00787af-26ff-421a-87e1-42ac9aa8e2e8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:25.027498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 498/970] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:24 2021] GET /identity/v3/users/f1ee6a2a566f4aeb8fbdab9bb3ed1a3c => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:25.033986 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7ff4f-c71c-400e-a484-1dc2720a39d7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:25.043898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7ff4f-c71c-400e-a484-1dc2720a39d7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:25.048358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cc241-3b2a-4d1f-a071-906991411c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:25.048984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cc241-3b2a-4d1f-a071-906991411c05 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:25.049266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cc241-3b2a-4d1f-a071-906991411c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:25.049545 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cc241-3b2a-4d1f-a071-906991411c05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:25.057633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cc241-3b2a-4d1f-a071-906991411c05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:25.059352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cc241-3b2a-4d1f-a071-906991411c05 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:25.068030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 473/971] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:25 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:25.073964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00787af-26ff-421a-87e1-42ac9aa8e2e8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:25.083170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00787af-26ff-421a-87e1-42ac9aa8e2e8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:25.087568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042464fc-b3ae-4e34-b249-7a9123980e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:25.088399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042464fc-b3ae-4e34-b249-7a9123980e6e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:25.088679 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042464fc-b3ae-4e34-b249-7a9123980e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:25.088951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042464fc-b3ae-4e34-b249-7a9123980e6e admin admin] PATH_INFO: `/v3/projects/7f55a86cd1a640d8be3448d061dcba59` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:25.090087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042464fc-b3ae-4e34-b249-7a9123980e6e admin admin] RBAC: Authorizing `identity:get_project(project_id=7f55a86cd1a640d8be3448d061dcba59)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:25.092130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042464fc-b3ae-4e34-b249-7a9123980e6e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:25.093727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 499/972] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:16:25 2021] GET /identity/v3/projects/7f55a86cd1a640d8be3448d061dcba59 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:25.100943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cc241-3b2a-4d1f-a071-906991411c05 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:25.109542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cc241-3b2a-4d1f-a071-906991411c05 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:25.114600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd3a6-ea64-4a01-8404-58e8bc3febbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:25.115256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd3a6-ea64-4a01-8404-58e8bc3febbd admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:25.115540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd3a6-ea64-4a01-8404-58e8bc3febbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:25.115818 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd3a6-ea64-4a01-8404-58e8bc3febbd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:25.116632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cd3a6-ea64-4a01-8404-58e8bc3febbd admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=7f55a86cd1a640d8be3448d061dcba59, user.id=f1ee6a2a566f4aeb8fbdab9bb3ed1a3c) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:25.116943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cd3a6-ea64-4a01-8404-58e8bc3febbd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:25.118757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cd3a6-ea64-4a01-8404-58e8bc3febbd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:25.124140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 474/973] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:25 2021] GET /identity/v3/role_assignments?user.id=f1ee6a2a566f4aeb8fbdab9bb3ed1a3c&scope.project.id=7f55a86cd1a640d8be3448d061dcba59&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:26.245120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae11f-4d6b-402c-bb44-5ed98ce2b925 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.245677 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae11f-4d6b-402c-bb44-5ed98ce2b925 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.245788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae11f-4d6b-402c-bb44-5ed98ce2b925 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.247642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 500/974] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:26.254293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00866e0d-90d9-41ac-a317-7c6050676ed3 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.254899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00866e0d-90d9-41ac-a317-7c6050676ed3 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.254899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00866e0d-90d9-41ac-a317-7c6050676ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.272880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-00866e0d-90d9-41ac-a317-7c6050676ed3 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:26.274047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-00866e0d-90d9-41ac-a317-7c6050676ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:26.281510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 475/975] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:26.305748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ae11f-4d6b-402c-bb44-5ed98ce2b925 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.318307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ae11f-4d6b-402c-bb44-5ed98ce2b925 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.322758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6aeaf-c460-4b4e-b56e-d1cc3f781a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.323552 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6aeaf-c460-4b4e-b56e-d1cc3f781a36 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.323836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6aeaf-c460-4b4e-b56e-d1cc3f781a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.324113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6aeaf-c460-4b4e-b56e-d1cc3f781a36 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.334638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6aeaf-c460-4b4e-b56e-d1cc3f781a36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:26.341990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-fae6aeaf-c460-4b4e-b56e-d1cc3f781a36 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 01:16:26.343184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 501/976] 10.222.0.23 () {56 vars in 1142 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:26.349811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00866e0d-90d9-41ac-a317-7c6050676ed3 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.358553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00866e0d-90d9-41ac-a317-7c6050676ed3 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.363015 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c4207-bf08-463e-92fd-cd989c8fed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.363656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c4207-bf08-463e-92fd-cd989c8fed40 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.363933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c4207-bf08-463e-92fd-cd989c8fed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.364205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c4207-bf08-463e-92fd-cd989c8fed40 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.364939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c4207-bf08-463e-92fd-cd989c8fed40 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:26.365237 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c4207-bf08-463e-92fd-cd989c8fed40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.366847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c4207-bf08-463e-92fd-cd989c8fed40 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.374618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 476/977] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:26.381088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6aeaf-c460-4b4e-b56e-d1cc3f781a36 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.391512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6aeaf-c460-4b4e-b56e-d1cc3f781a36 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.396605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3af3e-bef9-44ac-9355-a28d7a52f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.397366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3af3e-bef9-44ac-9355-a28d7a52f08e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.397654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3af3e-bef9-44ac-9355-a28d7a52f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.397931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3af3e-bef9-44ac-9355-a28d7a52f08e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.407832 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3af3e-bef9-44ac-9355-a28d7a52f08e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.409692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3af3e-bef9-44ac-9355-a28d7a52f08e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.425760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-7ba3af3e-bef9-44ac-9355-a28d7a52f08e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:26.426916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 502/978] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:26.432950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c4207-bf08-463e-92fd-cd989c8fed40 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.442931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c4207-bf08-463e-92fd-cd989c8fed40 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.447321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6222-35a2-4307-90c6-7b9a87aa452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.447946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6222-35a2-4307-90c6-7b9a87aa452f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.448227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6222-35a2-4307-90c6-7b9a87aa452f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.448500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6222-35a2-4307-90c6-7b9a87aa452f admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.449206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6222-35a2-4307-90c6-7b9a87aa452f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:26.449507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6222-35a2-4307-90c6-7b9a87aa452f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.451087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6222-35a2-4307-90c6-7b9a87aa452f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.462779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 477/979] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:26.468719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3af3e-bef9-44ac-9355-a28d7a52f08e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.477947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3af3e-bef9-44ac-9355-a28d7a52f08e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.482326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca04249-dca7-4947-b160-2c5107fd2001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.483119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca04249-dca7-4947-b160-2c5107fd2001 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.483402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca04249-dca7-4947-b160-2c5107fd2001 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.483674 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca04249-dca7-4947-b160-2c5107fd2001 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.491610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca04249-dca7-4947-b160-2c5107fd2001 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.493609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca04249-dca7-4947-b160-2c5107fd2001 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.507742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-2ca04249-dca7-4947-b160-2c5107fd2001 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 01:16:26.508845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 503/980] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:26.515378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6222-35a2-4307-90c6-7b9a87aa452f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.525459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6222-35a2-4307-90c6-7b9a87aa452f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.529884 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b319d9-7ef5-4f7c-991a-1d20be142113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.530526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b319d9-7ef5-4f7c-991a-1d20be142113 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.530845 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b319d9-7ef5-4f7c-991a-1d20be142113 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.531117 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b319d9-7ef5-4f7c-991a-1d20be142113 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.531943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b319d9-7ef5-4f7c-991a-1d20be142113 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:26.532250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b319d9-7ef5-4f7c-991a-1d20be142113 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.534062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b319d9-7ef5-4f7c-991a-1d20be142113 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.550406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 478/981] 10.222.0.23 () {56 vars in 1155 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:26.556482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca04249-dca7-4947-b160-2c5107fd2001 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.566642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca04249-dca7-4947-b160-2c5107fd2001 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.571069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fb7ae-4701-4474-8d4e-3b628bd8e3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.571693 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fb7ae-4701-4474-8d4e-3b628bd8e3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.571978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fb7ae-4701-4474-8d4e-3b628bd8e3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.572250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fb7ae-4701-4474-8d4e-3b628bd8e3a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.579677 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fb7ae-4701-4474-8d4e-3b628bd8e3a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.581946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fb7ae-4701-4474-8d4e-3b628bd8e3a3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.590374 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 504/982] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:26.596319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b319d9-7ef5-4f7c-991a-1d20be142113 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.605800 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b319d9-7ef5-4f7c-991a-1d20be142113 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.610247 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1d947-f3f7-493f-9b90-fece4acba095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.611046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1d947-f3f7-493f-9b90-fece4acba095 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.611332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1d947-f3f7-493f-9b90-fece4acba095 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.611612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1d947-f3f7-493f-9b90-fece4acba095 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.621540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1d947-f3f7-493f-9b90-fece4acba095 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.623395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1d947-f3f7-493f-9b90-fece4acba095 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.640413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-dce1d947-f3f7-493f-9b90-fece4acba095 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:16:26.641561 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 479/983] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:26.648450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fb7ae-4701-4474-8d4e-3b628bd8e3a3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.657194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fb7ae-4701-4474-8d4e-3b628bd8e3a3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.661732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcfd78-dd2d-4bd9-99df-f923cc17a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.662370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcfd78-dd2d-4bd9-99df-f923cc17a3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.662651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcfd78-dd2d-4bd9-99df-f923cc17a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.662966 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcfd78-dd2d-4bd9-99df-f923cc17a3d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.663676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcfd78-dd2d-4bd9-99df-f923cc17a3d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:26.663978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcfd78-dd2d-4bd9-99df-f923cc17a3d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.665547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcfd78-dd2d-4bd9-99df-f923cc17a3d6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.676534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 505/984] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:26.682655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1d947-f3f7-493f-9b90-fece4acba095 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.692564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1d947-f3f7-493f-9b90-fece4acba095 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.696930 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2a69-6074-432b-ade6-83d0aeeed8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.697741 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2a69-6074-432b-ade6-83d0aeeed8eb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.698024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2a69-6074-432b-ade6-83d0aeeed8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.698295 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e2a69-6074-432b-ade6-83d0aeeed8eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.704854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e2a69-6074-432b-ade6-83d0aeeed8eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.707429 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e2a69-6074-432b-ade6-83d0aeeed8eb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.719880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-167e2a69-6074-432b-ade6-83d0aeeed8eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:16:26.720987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 480/985] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:26.727118 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcfd78-dd2d-4bd9-99df-f923cc17a3d6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.736476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcfd78-dd2d-4bd9-99df-f923cc17a3d6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.741397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a739-dbfe-4bac-bffd-681bdd94664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.742033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a739-dbfe-4bac-bffd-681bdd94664a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.742312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a739-dbfe-4bac-bffd-681bdd94664a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.742584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a739-dbfe-4bac-bffd-681bdd94664a admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.743379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a739-dbfe-4bac-bffd-681bdd94664a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:26.743682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a739-dbfe-4bac-bffd-681bdd94664a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.745495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a739-dbfe-4bac-bffd-681bdd94664a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.759295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 506/986] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:26.766397 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2a69-6074-432b-ade6-83d0aeeed8eb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:26.776420 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e2a69-6074-432b-ade6-83d0aeeed8eb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:26.780768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc92c6-6a39-4d20-bb14-6381c36ba1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:26.781389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc92c6-6a39-4d20-bb14-6381c36ba1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:26.781666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc92c6-6a39-4d20-bb14-6381c36ba1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:26.781935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc92c6-6a39-4d20-bb14-6381c36ba1a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:26.782780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc92c6-6a39-4d20-bb14-6381c36ba1a6 admin admin] RBAC: Adding query filter params (role.id=1a8543e154214990bd46ec2d9719d019, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=d061cf5060334e79ab4f22518d37116f) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:26.783085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc92c6-6a39-4d20-bb14-6381c36ba1a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:26.784941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc92c6-6a39-4d20-bb14-6381c36ba1a6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:26.790520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 481/987] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:26 2021] GET /identity/v3/role_assignments?user.id=d061cf5060334e79ab4f22518d37116f&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=1a8543e154214990bd46ec2d9719d019 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:27.230266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f6df-2892-4bbb-98cb-3b77f46e9d30 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:27.230629 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f6df-2892-4bbb-98cb-3b77f46e9d30 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:27.230870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f6df-2892-4bbb-98cb-3b77f46e9d30 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:27.232640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 507/988] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:27.239314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b241eb-c883-4ab7-ab3d-22554c60a3a3 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:27.239605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b241eb-c883-4ab7-ab3d-22554c60a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:27.239886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b241eb-c883-4ab7-ab3d-22554c60a3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:27.257167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-27b241eb-c883-4ab7-ab3d-22554c60a3a3 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:27.258344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-27b241eb-c883-4ab7-ab3d-22554c60a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:27.266442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 482/989] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:27.290420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f6df-2892-4bbb-98cb-3b77f46e9d30 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:27.303568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f6df-2892-4bbb-98cb-3b77f46e9d30 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:27.307971 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24622a-400a-4466-8c29-2bc9bd52cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:27.308751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24622a-400a-4466-8c29-2bc9bd52cd4b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:27.309037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24622a-400a-4466-8c29-2bc9bd52cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:27.309314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24622a-400a-4466-8c29-2bc9bd52cd4b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:27.319709 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24622a-400a-4466-8c29-2bc9bd52cd4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:27.326516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-7d24622a-400a-4466-8c29-2bc9bd52cd4b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:16:27.327718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 508/990] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:16:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:27.334551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b241eb-c883-4ab7-ab3d-22554c60a3a3 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:27.343548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b241eb-c883-4ab7-ab3d-22554c60a3a3 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:27.348613 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3bfa7-8641-4e31-886c-3792d01d1194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:27.349268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3bfa7-8641-4e31-886c-3792d01d1194 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:27.349747 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3bfa7-8641-4e31-886c-3792d01d1194 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:27.349999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3bfa7-8641-4e31-886c-3792d01d1194 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:27.350555 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3bfa7-8641-4e31-886c-3792d01d1194 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:27.350892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3bfa7-8641-4e31-886c-3792d01d1194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:27.352483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3bfa7-8641-4e31-886c-3792d01d1194 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:27.361068 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 483/991] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:16:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:27.368133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24622a-400a-4466-8c29-2bc9bd52cd4b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:27.378016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24622a-400a-4466-8c29-2bc9bd52cd4b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:27.382645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4c721-7832-43f6-983c-9e18deb747a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:27.383607 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4c721-7832-43f6-983c-9e18deb747a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:27.383890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4c721-7832-43f6-983c-9e18deb747a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:27.384166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4c721-7832-43f6-983c-9e18deb747a2 admin admin] PATH_INFO: `/v3/users/f1ee6a2a566f4aeb8fbdab9bb3ed1a3c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:27.385352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4c721-7832-43f6-983c-9e18deb747a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=f1ee6a2a566f4aeb8fbdab9bb3ed1a3c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:27.387551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4c721-7832-43f6-983c-9e18deb747a2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:27.389719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 509/992] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:27 2021] GET /identity/v3/users/f1ee6a2a566f4aeb8fbdab9bb3ed1a3c => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:27.395797 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3bfa7-8641-4e31-886c-3792d01d1194 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:27.406062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3bfa7-8641-4e31-886c-3792d01d1194 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:27.411205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fa24f-0944-47b8-9ffa-db0fef7a0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:27.412044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fa24f-0944-47b8-9ffa-db0fef7a0cff admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:27.412331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fa24f-0944-47b8-9ffa-db0fef7a0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:27.412613 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fa24f-0944-47b8-9ffa-db0fef7a0cff admin admin] PATH_INFO: `/v3/projects/7f55a86cd1a640d8be3448d061dcba59` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:27.413791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fa24f-0944-47b8-9ffa-db0fef7a0cff admin admin] RBAC: Authorizing `identity:get_project(project_id=7f55a86cd1a640d8be3448d061dcba59)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:27.415876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fa24f-0944-47b8-9ffa-db0fef7a0cff admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:27.417525 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 484/993] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:16:27 2021] GET /identity/v3/projects/7f55a86cd1a640d8be3448d061dcba59 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:27.424302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4c721-7832-43f6-983c-9e18deb747a2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:27.435244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4c721-7832-43f6-983c-9e18deb747a2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:27.439816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f4978-9bab-47b9-882c-1e6b212fcfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:27.440717 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4978-9bab-47b9-882c-1e6b212fcfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:27.441006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4978-9bab-47b9-882c-1e6b212fcfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:27.441282 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4978-9bab-47b9-882c-1e6b212fcfcd admin admin] PATH_INFO: `/v3/projects/7f55a86cd1a640d8be3448d061dcba59/users/f1ee6a2a566f4aeb8fbdab9bb3ed1a3c/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:27.444104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f4978-9bab-47b9-882c-1e6b212fcfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f55a86cd1a640d8be3448d061dcba59, user_id=f1ee6a2a566f4aeb8fbdab9bb3ed1a3c, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:27.446797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f4978-9bab-47b9-882c-1e6b212fcfcd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:27.461663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 510/994] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:16:27 2021] PUT /identity/v3/projects/7f55a86cd1a640d8be3448d061dcba59/users/f1ee6a2a566f4aeb8fbdab9bb3ed1a3c/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:16:29.563717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f7780-a3f3-43fb-8925-b3f3878c4027 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:29.564293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f7780-a3f3-43fb-8925-b3f3878c4027 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:29.564293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f7780-a3f3-43fb-8925-b3f3878c4027 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:29.566527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 485/995] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:29.572239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1478-aa05-40a9-b30d-4026fa002883 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:29.572660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1478-aa05-40a9-b30d-4026fa002883 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:29.572792 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1478-aa05-40a9-b30d-4026fa002883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:29.590483 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-4aab1478-aa05-40a9-b30d-4026fa002883 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:29.591688 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4aab1478-aa05-40a9-b30d-4026fa002883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:29.645865 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 511/996] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:29.669150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f7780-a3f3-43fb-8925-b3f3878c4027 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:29.680889 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f7780-a3f3-43fb-8925-b3f3878c4027 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:29.685109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba7ff9-d589-4ee3-a597-d31d9816ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:29.685863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7ff9-d589-4ee3-a597-d31d9816ecef admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:29.686145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7ff9-d589-4ee3-a597-d31d9816ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:29.686418 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7ff9-d589-4ee3-a597-d31d9816ecef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:29.696585 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba7ff9-d589-4ee3-a597-d31d9816ecef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:29.703231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-2eba7ff9-d589-4ee3-a597-d31d9816ecef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:16:29.704341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 486/997] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:16:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:29.711096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab1478-aa05-40a9-b30d-4026fa002883 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:29.720028 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab1478-aa05-40a9-b30d-4026fa002883 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:29.724500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209f1a6-e280-4994-8bfc-266269b37007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:29.725146 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209f1a6-e280-4994-8bfc-266269b37007 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:29.725427 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209f1a6-e280-4994-8bfc-266269b37007 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:29.725701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209f1a6-e280-4994-8bfc-266269b37007 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:29.726434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209f1a6-e280-4994-8bfc-266269b37007 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:29.726770 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209f1a6-e280-4994-8bfc-266269b37007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:29.728360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209f1a6-e280-4994-8bfc-266269b37007 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:29.736279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 512/998] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:16:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:29.743005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba7ff9-d589-4ee3-a597-d31d9816ecef admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:29.753794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba7ff9-d589-4ee3-a597-d31d9816ecef admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:29.759903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981bc34-71f6-4b75-8bdb-895521c81fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:29.760676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981bc34-71f6-4b75-8bdb-895521c81fef admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:29.760953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981bc34-71f6-4b75-8bdb-895521c81fef admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:29.761227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981bc34-71f6-4b75-8bdb-895521c81fef admin admin] PATH_INFO: `/v3/users/f1ee6a2a566f4aeb8fbdab9bb3ed1a3c` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:29.762381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981bc34-71f6-4b75-8bdb-895521c81fef admin admin] RBAC: Authorizing `identity:get_user(user_id=f1ee6a2a566f4aeb8fbdab9bb3ed1a3c)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:29.764776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981bc34-71f6-4b75-8bdb-895521c81fef admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:29.766310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 487/999] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:29 2021] GET /identity/v3/users/f1ee6a2a566f4aeb8fbdab9bb3ed1a3c => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:29.772216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209f1a6-e280-4994-8bfc-266269b37007 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:29.781443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209f1a6-e280-4994-8bfc-266269b37007 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:29.785927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305372b-69bb-4c5a-918c-85d050716eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:29.786540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305372b-69bb-4c5a-918c-85d050716eaa admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:29.786855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305372b-69bb-4c5a-918c-85d050716eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:29.787133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305372b-69bb-4c5a-918c-85d050716eaa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:29.795030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305372b-69bb-4c5a-918c-85d050716eaa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:29.796763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305372b-69bb-4c5a-918c-85d050716eaa admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:29.805885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 513/1000] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:29 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:29.811783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981bc34-71f6-4b75-8bdb-895521c81fef admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:29.821446 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981bc34-71f6-4b75-8bdb-895521c81fef admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:29.825787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e2128-91b6-4f6a-bedb-bf96411ad294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:29.826590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e2128-91b6-4f6a-bedb-bf96411ad294 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:29.826898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e2128-91b6-4f6a-bedb-bf96411ad294 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:29.827171 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e2128-91b6-4f6a-bedb-bf96411ad294 admin admin] PATH_INFO: `/v3/projects/7f55a86cd1a640d8be3448d061dcba59` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:29.828313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e2128-91b6-4f6a-bedb-bf96411ad294 admin admin] RBAC: Authorizing `identity:get_project(project_id=7f55a86cd1a640d8be3448d061dcba59)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:29.830272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e2128-91b6-4f6a-bedb-bf96411ad294 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:29.831933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 488/1001] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:16:29 2021] GET /identity/v3/projects/7f55a86cd1a640d8be3448d061dcba59 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:29.838011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305372b-69bb-4c5a-918c-85d050716eaa admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:29.846353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305372b-69bb-4c5a-918c-85d050716eaa admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:29.850881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d3c3c-a119-4120-aa92-569c62a8846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:29.851491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d3c3c-a119-4120-aa92-569c62a8846d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:29.851776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d3c3c-a119-4120-aa92-569c62a8846d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:29.852052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d3c3c-a119-4120-aa92-569c62a8846d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:29.852853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d3c3c-a119-4120-aa92-569c62a8846d admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=7f55a86cd1a640d8be3448d061dcba59, user.id=f1ee6a2a566f4aeb8fbdab9bb3ed1a3c) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:29.853165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d3c3c-a119-4120-aa92-569c62a8846d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:29.854960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d3c3c-a119-4120-aa92-569c62a8846d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:29.860511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 514/1002] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:29 2021] GET /identity/v3/role_assignments?user.id=f1ee6a2a566f4aeb8fbdab9bb3ed1a3c&scope.project.id=7f55a86cd1a640d8be3448d061dcba59&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:32.014189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de2956-4506-44c3-82c7-240e8b7fedc3 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:32.014780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de2956-4506-44c3-82c7-240e8b7fedc3 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:32.014780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de2956-4506-44c3-82c7-240e8b7fedc3 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:32.016536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 489/1003] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:32.022851 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea292fa-c792-482c-98ee-7e7d1a178ed8 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:32.023230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea292fa-c792-482c-98ee-7e7d1a178ed8 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:32.023416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea292fa-c792-482c-98ee-7e7d1a178ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:32.041156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-9ea292fa-c792-482c-98ee-7e7d1a178ed8 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:32.042336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9ea292fa-c792-482c-98ee-7e7d1a178ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:32.050197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 515/1004] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:32.075010 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de2956-4506-44c3-82c7-240e8b7fedc3 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:32.087380 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de2956-4506-44c3-82c7-240e8b7fedc3 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:32.091727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a532dc-1f86-4980-a718-d2031a7869e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:32.092484 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a532dc-1f86-4980-a718-d2031a7869e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:32.092770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a532dc-1f86-4980-a718-d2031a7869e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:32.093047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a532dc-1f86-4980-a718-d2031a7869e4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:32.094205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a532dc-1f86-4980-a718-d2031a7869e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:32.096040 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a532dc-1f86-4980-a718-d2031a7869e4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:32.098189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 490/1005] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:32.103885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea292fa-c792-482c-98ee-7e7d1a178ed8 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:32.112507 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea292fa-c792-482c-98ee-7e7d1a178ed8 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:32.116927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6c2fb-6ffd-4da2-ad38-2f4e6053161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:32.117565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6c2fb-6ffd-4da2-ad38-2f4e6053161f admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:32.117847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6c2fb-6ffd-4da2-ad38-2f4e6053161f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:32.118123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6c2fb-6ffd-4da2-ad38-2f4e6053161f admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:32.118847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6c2fb-6ffd-4da2-ad38-2f4e6053161f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:32.120727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6c2fb-6ffd-4da2-ad38-2f4e6053161f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:32.140480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 516/1006] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:16:32 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:34.297191 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668d7a2-db81-4488-8c6e-dff32b5d765c None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:34.297721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668d7a2-db81-4488-8c6e-dff32b5d765c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:34.297721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668d7a2-db81-4488-8c6e-dff32b5d765c None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:34.300009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 491/1007] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:34.305790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c393200-4e33-4af6-8c2d-65216605b00d None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:34.306168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c393200-4e33-4af6-8c2d-65216605b00d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:34.306343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c393200-4e33-4af6-8c2d-65216605b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:34.323995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8c393200-4e33-4af6-8c2d-65216605b00d None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:34.325186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8c393200-4e33-4af6-8c2d-65216605b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:34.332696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 517/1008] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:34.356522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668d7a2-db81-4488-8c6e-dff32b5d765c None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:34.368683 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668d7a2-db81-4488-8c6e-dff32b5d765c None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:34.372897 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593570c9-ec9c-402f-9bd6-c6db6d82db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:34.373712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593570c9-ec9c-402f-9bd6-c6db6d82db44 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:34.374016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593570c9-ec9c-402f-9bd6-c6db6d82db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:34.374284 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593570c9-ec9c-402f-9bd6-c6db6d82db44 admin admin] PATH_INFO: `/v3/roles/b3e69d8143774de5aa40d1fd070a8c03` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:34.375734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593570c9-ec9c-402f-9bd6-c6db6d82db44 admin admin] RBAC: Authorizing `identity:get_role(role_id=b3e69d8143774de5aa40d1fd070a8c03)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:34.376725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-593570c9-ec9c-402f-9bd6-c6db6d82db44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:16:34.376725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:16:34.376725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:16:34.377621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593570c9-ec9c-402f-9bd6-c6db6d82db44 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:34.379549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 492/1009] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:34 2021] GET /identity/v3/roles/b3e69d8143774de5aa40d1fd070a8c03 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:34.385299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c393200-4e33-4af6-8c2d-65216605b00d None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:34.394191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c393200-4e33-4af6-8c2d-65216605b00d None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:34.398595 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0e32-08eb-4def-aa18-fc4d26f82b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:34.399463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0e32-08eb-4def-aa18-fc4d26f82b14 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:34.399743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0e32-08eb-4def-aa18-fc4d26f82b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:34.400017 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0e32-08eb-4def-aa18-fc4d26f82b14 admin admin] PATH_INFO: `/v3/users/32e3478197724a1bb9e9884add518e12` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:34.412624 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d0e32-08eb-4def-aa18-fc4d26f82b14 admin admin] RBAC: Authorizing `identity:get_user(user_id=32e3478197724a1bb9e9884add518e12)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:34.414766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d0e32-08eb-4def-aa18-fc4d26f82b14 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:34.416313 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 518/1010] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:34 2021] GET /identity/v3/users/32e3478197724a1bb9e9884add518e12 => generated 286 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:34.422169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593570c9-ec9c-402f-9bd6-c6db6d82db44 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:34.433057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593570c9-ec9c-402f-9bd6-c6db6d82db44 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:34.437707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5469e-7dc0-484e-8b05-cdcc7b27b9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:34.438319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5469e-7dc0-484e-8b05-cdcc7b27b9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:34.438599 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5469e-7dc0-484e-8b05-cdcc7b27b9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:34.438901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5469e-7dc0-484e-8b05-cdcc7b27b9c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:34.446967 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5469e-7dc0-484e-8b05-cdcc7b27b9c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:34.448681 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5469e-7dc0-484e-8b05-cdcc7b27b9c1 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:34.457098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 493/1011] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:34.463333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0e32-08eb-4def-aa18-fc4d26f82b14 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:34.472648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0e32-08eb-4def-aa18-fc4d26f82b14 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:34.477136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e82ba-7994-4e99-819c-572b71a5e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:34.477964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e82ba-7994-4e99-819c-572b71a5e334 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:34.478252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e82ba-7994-4e99-819c-572b71a5e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:34.478531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e82ba-7994-4e99-819c-572b71a5e334 admin admin] PATH_INFO: `/v3/projects/7f55a86cd1a640d8be3448d061dcba59` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:34.479734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e82ba-7994-4e99-819c-572b71a5e334 admin admin] RBAC: Authorizing `identity:get_project(project_id=7f55a86cd1a640d8be3448d061dcba59)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:34.481776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e82ba-7994-4e99-819c-572b71a5e334 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:34.483436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 519/1012] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:16:34 2021] GET /identity/v3/projects/7f55a86cd1a640d8be3448d061dcba59 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:34.490343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5469e-7dc0-484e-8b05-cdcc7b27b9c1 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:34.498971 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5469e-7dc0-484e-8b05-cdcc7b27b9c1 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:34.504138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4552c-8738-433a-aea5-9d6ea8e63106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:34.504763 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4552c-8738-433a-aea5-9d6ea8e63106 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:34.505045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4552c-8738-433a-aea5-9d6ea8e63106 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:34.505319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4552c-8738-433a-aea5-9d6ea8e63106 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:34.506149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4552c-8738-433a-aea5-9d6ea8e63106 admin admin] RBAC: Adding query filter params (role.id=b3e69d8143774de5aa40d1fd070a8c03, scope.project.id=7f55a86cd1a640d8be3448d061dcba59, user.id=32e3478197724a1bb9e9884add518e12) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:34.506457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4552c-8738-433a-aea5-9d6ea8e63106 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:34.508331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4552c-8738-433a-aea5-9d6ea8e63106 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:34.513856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 494/1013] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:34 2021] GET /identity/v3/role_assignments?user.id=32e3478197724a1bb9e9884add518e12&scope.project.id=7f55a86cd1a640d8be3448d061dcba59&role.id=b3e69d8143774de5aa40d1fd070a8c03 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:36.593968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb152c3c-9866-4177-a367-07b96e540c04 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:36.594493 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb152c3c-9866-4177-a367-07b96e540c04 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:36.594610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb152c3c-9866-4177-a367-07b96e540c04 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:36.596940 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 520/1014] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:36.602618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101403-a611-48df-ada9-df417e42d175 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:36.603053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101403-a611-48df-ada9-df417e42d175 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:36.603209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101403-a611-48df-ada9-df417e42d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:36.621015 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-cc101403-a611-48df-ada9-df417e42d175 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:36.622186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-cc101403-a611-48df-ada9-df417e42d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:36.629716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 495/1015] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:36.653365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb152c3c-9866-4177-a367-07b96e540c04 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:36.665867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb152c3c-9866-4177-a367-07b96e540c04 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:36.670246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c8825-c236-45a3-8a77-10e01a7c7cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:36.671109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c8825-c236-45a3-8a77-10e01a7c7cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:36.671395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c8825-c236-45a3-8a77-10e01a7c7cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:36.671670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c8825-c236-45a3-8a77-10e01a7c7cd9 admin admin] PATH_INFO: `/v3/roles/b3e69d8143774de5aa40d1fd070a8c03` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:36.673122 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c8825-c236-45a3-8a77-10e01a7c7cd9 admin admin] RBAC: Authorizing `identity:get_role(role_id=b3e69d8143774de5aa40d1fd070a8c03)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:36.674133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-563c8825-c236-45a3-8a77-10e01a7c7cd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:16:36.674133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:16:36.674133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:16:36.675100 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c8825-c236-45a3-8a77-10e01a7c7cd9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:36.676386 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 521/1016] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:36 2021] GET /identity/v3/roles/b3e69d8143774de5aa40d1fd070a8c03 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:36.682104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc101403-a611-48df-ada9-df417e42d175 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:36.690615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc101403-a611-48df-ada9-df417e42d175 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:36.695037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e013e8-5556-4c74-9c36-2d3a2b892dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:36.695863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e013e8-5556-4c74-9c36-2d3a2b892dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:36.696142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e013e8-5556-4c74-9c36-2d3a2b892dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:36.696410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e013e8-5556-4c74-9c36-2d3a2b892dc5 admin admin] PATH_INFO: `/v3/users/32e3478197724a1bb9e9884add518e12` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:36.697576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e013e8-5556-4c74-9c36-2d3a2b892dc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=32e3478197724a1bb9e9884add518e12)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:36.699679 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e013e8-5556-4c74-9c36-2d3a2b892dc5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:36.701301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 496/1017] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:36 2021] GET /identity/v3/users/32e3478197724a1bb9e9884add518e12 => generated 286 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:36.707396 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c8825-c236-45a3-8a77-10e01a7c7cd9 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:36.718383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c8825-c236-45a3-8a77-10e01a7c7cd9 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:36.723461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f892d-e5b6-4e8c-833d-ee1483382627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:36.724252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f892d-e5b6-4e8c-833d-ee1483382627 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:36.724535 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f892d-e5b6-4e8c-833d-ee1483382627 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:36.724810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f892d-e5b6-4e8c-833d-ee1483382627 admin admin] PATH_INFO: `/v3/projects/7f55a86cd1a640d8be3448d061dcba59` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:36.725950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f892d-e5b6-4e8c-833d-ee1483382627 admin admin] RBAC: Authorizing `identity:get_project(project_id=7f55a86cd1a640d8be3448d061dcba59)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:36.727968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f892d-e5b6-4e8c-833d-ee1483382627 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:36.729659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 522/1018] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:16:36 2021] GET /identity/v3/projects/7f55a86cd1a640d8be3448d061dcba59 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:36.735372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e013e8-5556-4c74-9c36-2d3a2b892dc5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:36.744372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e013e8-5556-4c74-9c36-2d3a2b892dc5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:36.748801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134e158-e885-4006-bdf1-052c5f12aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:36.749617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134e158-e885-4006-bdf1-052c5f12aa1d admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:36.749898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134e158-e885-4006-bdf1-052c5f12aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:36.750174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134e158-e885-4006-bdf1-052c5f12aa1d admin admin] PATH_INFO: `/v3/projects/7f55a86cd1a640d8be3448d061dcba59/users/32e3478197724a1bb9e9884add518e12/roles/b3e69d8143774de5aa40d1fd070a8c03` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:36.752320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134e158-e885-4006-bdf1-052c5f12aa1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f55a86cd1a640d8be3448d061dcba59, user_id=32e3478197724a1bb9e9884add518e12, role_id=b3e69d8143774de5aa40d1fd070a8c03)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:36.754921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134e158-e885-4006-bdf1-052c5f12aa1d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:36.767891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 497/1019] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:16:36 2021] PUT /identity/v3/projects/7f55a86cd1a640d8be3448d061dcba59/users/32e3478197724a1bb9e9884add518e12/roles/b3e69d8143774de5aa40d1fd070a8c03 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:16:38.864048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b81ad-32f3-421d-bf0f-510b4313b929 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:38.864546 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b81ad-32f3-421d-bf0f-510b4313b929 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:38.864546 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b81ad-32f3-421d-bf0f-510b4313b929 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:38.866259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 523/1020] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:38.872128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73729f27-9249-40d8-93ce-a3cbdf5b6621 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:38.872521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73729f27-9249-40d8-93ce-a3cbdf5b6621 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:38.872685 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73729f27-9249-40d8-93ce-a3cbdf5b6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:38.890559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-73729f27-9249-40d8-93ce-a3cbdf5b6621 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:38.891767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-73729f27-9249-40d8-93ce-a3cbdf5b6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:38.945618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 498/1021] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:38.970175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b81ad-32f3-421d-bf0f-510b4313b929 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:38.982522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b81ad-32f3-421d-bf0f-510b4313b929 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:38.986782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5e91-30dc-4228-93fd-90d6d5084dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:38.987603 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5e91-30dc-4228-93fd-90d6d5084dad admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:38.987882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5e91-30dc-4228-93fd-90d6d5084dad admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:38.988154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5e91-30dc-4228-93fd-90d6d5084dad admin admin] PATH_INFO: `/v3/roles/b3e69d8143774de5aa40d1fd070a8c03` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:38.989589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab5e91-30dc-4228-93fd-90d6d5084dad admin admin] RBAC: Authorizing `identity:get_role(role_id=b3e69d8143774de5aa40d1fd070a8c03)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:38.991192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab5e91-30dc-4228-93fd-90d6d5084dad admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:38.992460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 524/1022] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:38 2021] GET /identity/v3/roles/b3e69d8143774de5aa40d1fd070a8c03 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:38.998385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73729f27-9249-40d8-93ce-a3cbdf5b6621 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:39.006879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73729f27-9249-40d8-93ce-a3cbdf5b6621 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:39.011257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e7ec4-ea3e-47f6-b520-bc981cbb9d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:39.012127 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7ec4-ea3e-47f6-b520-bc981cbb9d4a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:39.012409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7ec4-ea3e-47f6-b520-bc981cbb9d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:39.012683 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7ec4-ea3e-47f6-b520-bc981cbb9d4a admin admin] PATH_INFO: `/v3/users/32e3478197724a1bb9e9884add518e12` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:39.014104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e7ec4-ea3e-47f6-b520-bc981cbb9d4a admin admin] RBAC: Authorizing `identity:get_user(user_id=32e3478197724a1bb9e9884add518e12)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:39.016230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e7ec4-ea3e-47f6-b520-bc981cbb9d4a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:39.017753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 499/1023] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:38 2021] GET /identity/v3/users/32e3478197724a1bb9e9884add518e12 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:39.024324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5e91-30dc-4228-93fd-90d6d5084dad admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:39.038726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5e91-30dc-4228-93fd-90d6d5084dad admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:39.043101 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75546c8f-824c-4af6-baa9-ff0a265aa266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:39.043711 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546c8f-824c-4af6-baa9-ff0a265aa266 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:39.043993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546c8f-824c-4af6-baa9-ff0a265aa266 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:39.044269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546c8f-824c-4af6-baa9-ff0a265aa266 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:39.051713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75546c8f-824c-4af6-baa9-ff0a265aa266 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:39.053410 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75546c8f-824c-4af6-baa9-ff0a265aa266 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:39.061862 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 525/1024] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:39 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:39.068414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e7ec4-ea3e-47f6-b520-bc981cbb9d4a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:39.077526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e7ec4-ea3e-47f6-b520-bc981cbb9d4a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:39.082525 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4df12-9de3-409e-941d-d7bda962bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:39.083641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4df12-9de3-409e-941d-d7bda962bf02 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:39.083925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4df12-9de3-409e-941d-d7bda962bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:39.084203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4df12-9de3-409e-941d-d7bda962bf02 admin admin] PATH_INFO: `/v3/projects/7f55a86cd1a640d8be3448d061dcba59` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:39.085342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4df12-9de3-409e-941d-d7bda962bf02 admin admin] RBAC: Authorizing `identity:get_project(project_id=7f55a86cd1a640d8be3448d061dcba59)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:39.087359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4df12-9de3-409e-941d-d7bda962bf02 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:39.088945 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 500/1025] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:16:39 2021] GET /identity/v3/projects/7f55a86cd1a640d8be3448d061dcba59 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:39.095002 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75546c8f-824c-4af6-baa9-ff0a265aa266 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:39.103285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75546c8f-824c-4af6-baa9-ff0a265aa266 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:39.107672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681ce6e-3003-47a4-9334-53370a9dfcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:39.108269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681ce6e-3003-47a4-9334-53370a9dfcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:39.108548 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681ce6e-3003-47a4-9334-53370a9dfcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:39.108821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681ce6e-3003-47a4-9334-53370a9dfcf7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:39.109612 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681ce6e-3003-47a4-9334-53370a9dfcf7 admin admin] RBAC: Adding query filter params (role.id=b3e69d8143774de5aa40d1fd070a8c03, scope.project.id=7f55a86cd1a640d8be3448d061dcba59, user.id=32e3478197724a1bb9e9884add518e12) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:39.109917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681ce6e-3003-47a4-9334-53370a9dfcf7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:39.111714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681ce6e-3003-47a4-9334-53370a9dfcf7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:39.117249 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 526/1026] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:39 2021] GET /identity/v3/role_assignments?user.id=32e3478197724a1bb9e9884add518e12&scope.project.id=7f55a86cd1a640d8be3448d061dcba59&role.id=b3e69d8143774de5aa40d1fd070a8c03 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:41.267637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7ca0-d9ae-4d33-920f-a1d673de9155 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:41.268412 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7ca0-d9ae-4d33-920f-a1d673de9155 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:41.268412 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c7ca0-d9ae-4d33-920f-a1d673de9155 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:41.269940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 501/1027] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:16:41.276068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c92c7-ef3b-4905-9fa3-62da682baa69 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:41.276496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c92c7-ef3b-4905-9fa3-62da682baa69 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:41.276632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c92c7-ef3b-4905-9fa3-62da682baa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:41.293669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d90c92c7-ef3b-4905-9fa3-62da682baa69 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:41.294876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d90c92c7-ef3b-4905-9fa3-62da682baa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:41.302898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 527/1028] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:16:41.327759 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c7ca0-d9ae-4d33-920f-a1d673de9155 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:41.339741 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c7ca0-d9ae-4d33-920f-a1d673de9155 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:41.343946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d65b57-9a8c-439f-a388-b9dc75355a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:41.344703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d65b57-9a8c-439f-a388-b9dc75355a77 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:41.344983 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d65b57-9a8c-439f-a388-b9dc75355a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:41.345256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d65b57-9a8c-439f-a388-b9dc75355a77 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:41.346907 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d65b57-9a8c-439f-a388-b9dc75355a77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:41.348548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d65b57-9a8c-439f-a388-b9dc75355a77 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:41.350061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 502/1029] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:41.356200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c92c7-ef3b-4905-9fa3-62da682baa69 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:41.365374 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c92c7-ef3b-4905-9fa3-62da682baa69 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:41.370184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3db44-0c1a-446e-b054-202eaedb09b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:41.370852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3db44-0c1a-446e-b054-202eaedb09b1 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:41.371138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3db44-0c1a-446e-b054-202eaedb09b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:41.371886 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3db44-0c1a-446e-b054-202eaedb09b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:41.372621 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3db44-0c1a-446e-b054-202eaedb09b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:41.374490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3db44-0c1a-446e-b054-202eaedb09b1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:41.398400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 528/1030] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:16:41 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:43.538609 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9747764-c867-433e-a549-2564b1ead677 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:43.539067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9747764-c867-433e-a549-2564b1ead677 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:43.539194 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9747764-c867-433e-a549-2564b1ead677 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:43.540964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 503/1031] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:43.546987 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d1c84-4822-4fcf-915a-14709e3c4dae None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:43.547369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d1c84-4822-4fcf-915a-14709e3c4dae None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:43.547557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d1c84-4822-4fcf-915a-14709e3c4dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:43.572442 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e40d1c84-4822-4fcf-915a-14709e3c4dae None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:43.573638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e40d1c84-4822-4fcf-915a-14709e3c4dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:43.628018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 529/1032] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:43.654265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9747764-c867-433e-a549-2564b1ead677 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:43.666052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9747764-c867-433e-a549-2564b1ead677 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:43.670384 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c436b5f-8121-466c-9c5e-2a65c1b07297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:43.671183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c436b5f-8121-466c-9c5e-2a65c1b07297 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:43.671461 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c436b5f-8121-466c-9c5e-2a65c1b07297 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:43.671732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c436b5f-8121-466c-9c5e-2a65c1b07297 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:43.672879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c436b5f-8121-466c-9c5e-2a65c1b07297 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:43.674534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c436b5f-8121-466c-9c5e-2a65c1b07297 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:43.676096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 504/1033] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:16:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:43.681915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d1c84-4822-4fcf-915a-14709e3c4dae None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:43.691117 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d1c84-4822-4fcf-915a-14709e3c4dae None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:43.695581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8dacb3-a599-45b2-826a-968214cf47ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:43.696229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8dacb3-a599-45b2-826a-968214cf47ae admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:43.696516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8dacb3-a599-45b2-826a-968214cf47ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:43.696797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8dacb3-a599-45b2-826a-968214cf47ae admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:43.697491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8dacb3-a599-45b2-826a-968214cf47ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:43.699424 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8dacb3-a599-45b2-826a-968214cf47ae admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:43.718367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 530/1034] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:16:43 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:45.887717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80488e-f7ec-4d77-aede-2e96b3f5741d None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:45.888509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80488e-f7ec-4d77-aede-2e96b3f5741d None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:45.888509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80488e-f7ec-4d77-aede-2e96b3f5741d None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:45.890191 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 505/1035] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:45.896193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35c70-d106-43c3-a59c-25d31332ac97 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:45.896582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35c70-d106-43c3-a59c-25d31332ac97 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:45.896754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35c70-d106-43c3-a59c-25d31332ac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:45.915944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c1a35c70-d106-43c3-a59c-25d31332ac97 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:45.917183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c1a35c70-d106-43c3-a59c-25d31332ac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:45.925321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 531/1036] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:45.948987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80488e-f7ec-4d77-aede-2e96b3f5741d None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:45.960873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80488e-f7ec-4d77-aede-2e96b3f5741d None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:45.965074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c3f4a-c539-4010-83dc-7048e2b6c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:45.965828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c3f4a-c539-4010-83dc-7048e2b6c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:45.966106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c3f4a-c539-4010-83dc-7048e2b6c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:45.966378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c3f4a-c539-4010-83dc-7048e2b6c8ce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:45.976590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c3f4a-c539-4010-83dc-7048e2b6c8ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:45.983214 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-8b7c3f4a-c539-4010-83dc-7048e2b6c8ce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:16:45.984326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 506/1037] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:16:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:45.991145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a35c70-d106-43c3-a59c-25d31332ac97 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:45.999799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a35c70-d106-43c3-a59c-25d31332ac97 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:46.004384 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33b02c-12e5-4c69-9369-5fd2522b53bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:46.005038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33b02c-12e5-4c69-9369-5fd2522b53bd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:46.005322 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33b02c-12e5-4c69-9369-5fd2522b53bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:46.005598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33b02c-12e5-4c69-9369-5fd2522b53bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:46.006330 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33b02c-12e5-4c69-9369-5fd2522b53bd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:46.006633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33b02c-12e5-4c69-9369-5fd2522b53bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:46.008237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33b02c-12e5-4c69-9369-5fd2522b53bd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:46.016620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 532/1038] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:16:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:46.022862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c3f4a-c539-4010-83dc-7048e2b6c8ce admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:46.032437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c3f4a-c539-4010-83dc-7048e2b6c8ce admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:46.037347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b118-6430-4e70-919b-deec80bc502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:46.038160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b118-6430-4e70-919b-deec80bc502d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:46.038440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b118-6430-4e70-919b-deec80bc502d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:46.038747 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b118-6430-4e70-919b-deec80bc502d admin admin] PATH_INFO: `/v3/users/cdfadc90954540a0a1b2baa3a5c971b1` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:46.051697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11b118-6430-4e70-919b-deec80bc502d admin admin] RBAC: Authorizing `identity:get_user(user_id=cdfadc90954540a0a1b2baa3a5c971b1)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:46.053786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11b118-6430-4e70-919b-deec80bc502d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:46.055376 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 507/1039] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:46 2021] GET /identity/v3/users/cdfadc90954540a0a1b2baa3a5c971b1 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:16:46.061373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33b02c-12e5-4c69-9369-5fd2522b53bd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:46.070652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33b02c-12e5-4c69-9369-5fd2522b53bd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:46.075160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7311155-6d51-4d4d-a075-bd307476cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:46.075777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311155-6d51-4d4d-a075-bd307476cc37 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:46.076061 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311155-6d51-4d4d-a075-bd307476cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:46.076361 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311155-6d51-4d4d-a075-bd307476cc37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:46.083925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7311155-6d51-4d4d-a075-bd307476cc37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:46.085638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7311155-6d51-4d4d-a075-bd307476cc37 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:46.094258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 533/1040] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:46 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:46.100577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b118-6430-4e70-919b-deec80bc502d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:46.109475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b118-6430-4e70-919b-deec80bc502d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:46.114445 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a99015-2e3c-4388-a5ac-f8632248572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:46.115277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99015-2e3c-4388-a5ac-f8632248572a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:46.115556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99015-2e3c-4388-a5ac-f8632248572a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:46.115828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99015-2e3c-4388-a5ac-f8632248572a admin admin] PATH_INFO: `/v3/projects/77afdeb59def454e98929fed403aa68f` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:46.116943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99015-2e3c-4388-a5ac-f8632248572a admin admin] RBAC: Authorizing `identity:get_project(project_id=77afdeb59def454e98929fed403aa68f)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:46.118923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99015-2e3c-4388-a5ac-f8632248572a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:46.120498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 508/1041] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:16:46 2021] GET /identity/v3/projects/77afdeb59def454e98929fed403aa68f => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:46.126640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7311155-6d51-4d4d-a075-bd307476cc37 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:46.134998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7311155-6d51-4d4d-a075-bd307476cc37 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:46.139785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73719503-5101-4665-af62-29615fdef359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:46.140328 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73719503-5101-4665-af62-29615fdef359 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:46.140613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73719503-5101-4665-af62-29615fdef359 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:46.140894 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73719503-5101-4665-af62-29615fdef359 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:46.141685 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73719503-5101-4665-af62-29615fdef359 admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=77afdeb59def454e98929fed403aa68f, user.id=cdfadc90954540a0a1b2baa3a5c971b1) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:46.141996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73719503-5101-4665-af62-29615fdef359 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:46.143802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73719503-5101-4665-af62-29615fdef359 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:46.149038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 534/1042] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:46 2021] GET /identity/v3/role_assignments?user.id=cdfadc90954540a0a1b2baa3a5c971b1&scope.project.id=77afdeb59def454e98929fed403aa68f&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:48.235415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc767-7ddc-4ab9-bd60-6f2fe4a17903 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:48.235997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc767-7ddc-4ab9-bd60-6f2fe4a17903 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:48.235997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc767-7ddc-4ab9-bd60-6f2fe4a17903 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:48.237765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 509/1043] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:48.243590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb5224-e05c-44c9-9eb2-334396b0bf70 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:48.243979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb5224-e05c-44c9-9eb2-334396b0bf70 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:48.244153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb5224-e05c-44c9-9eb2-334396b0bf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:48.261733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-1dbb5224-e05c-44c9-9eb2-334396b0bf70 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:48.262949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1dbb5224-e05c-44c9-9eb2-334396b0bf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:48.271324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 535/1044] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:48.294351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bc767-7ddc-4ab9-bd60-6f2fe4a17903 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:48.306084 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bc767-7ddc-4ab9-bd60-6f2fe4a17903 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:48.310345 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4969758-090d-404a-82d0-0c5dcb474ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:48.311129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969758-090d-404a-82d0-0c5dcb474ccb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:48.311409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969758-090d-404a-82d0-0c5dcb474ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:48.311678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969758-090d-404a-82d0-0c5dcb474ccb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:48.321980 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4969758-090d-404a-82d0-0c5dcb474ccb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:48.328678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-e4969758-090d-404a-82d0-0c5dcb474ccb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:16:48.329790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 510/1045] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:16:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:48.336528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb5224-e05c-44c9-9eb2-334396b0bf70 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:48.345167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb5224-e05c-44c9-9eb2-334396b0bf70 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:48.349598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec7f9b-6370-4b2e-856f-a542a807eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:48.350231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec7f9b-6370-4b2e-856f-a542a807eaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:48.350515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec7f9b-6370-4b2e-856f-a542a807eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:48.350834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec7f9b-6370-4b2e-856f-a542a807eaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:48.351562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec7f9b-6370-4b2e-856f-a542a807eaa1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:48.351866 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec7f9b-6370-4b2e-856f-a542a807eaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:48.353439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec7f9b-6370-4b2e-856f-a542a807eaa1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:48.361315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 536/1046] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:16:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:48.367141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4969758-090d-404a-82d0-0c5dcb474ccb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:48.376792 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4969758-090d-404a-82d0-0c5dcb474ccb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:48.381755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee943c3-ce00-4a66-b2ec-f9d1514c48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:48.382554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee943c3-ce00-4a66-b2ec-f9d1514c48ee admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:48.382870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee943c3-ce00-4a66-b2ec-f9d1514c48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:48.383148 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee943c3-ce00-4a66-b2ec-f9d1514c48ee admin admin] PATH_INFO: `/v3/users/cdfadc90954540a0a1b2baa3a5c971b1` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:48.384312 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee943c3-ce00-4a66-b2ec-f9d1514c48ee admin admin] RBAC: Authorizing `identity:get_user(user_id=cdfadc90954540a0a1b2baa3a5c971b1)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:48.386405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee943c3-ce00-4a66-b2ec-f9d1514c48ee admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:48.388331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 511/1047] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:48 2021] GET /identity/v3/users/cdfadc90954540a0a1b2baa3a5c971b1 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:48.394335 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec7f9b-6370-4b2e-856f-a542a807eaa1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:48.403459 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec7f9b-6370-4b2e-856f-a542a807eaa1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:48.407844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcce21b-f142-421f-95fa-95d6001564df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:48.408649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce21b-f142-421f-95fa-95d6001564df admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:48.408924 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce21b-f142-421f-95fa-95d6001564df admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:48.409193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce21b-f142-421f-95fa-95d6001564df admin admin] PATH_INFO: `/v3/projects/77afdeb59def454e98929fed403aa68f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:48.410319 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcce21b-f142-421f-95fa-95d6001564df admin admin] RBAC: Authorizing `identity:get_project(project_id=77afdeb59def454e98929fed403aa68f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:48.412343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcce21b-f142-421f-95fa-95d6001564df admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:48.413893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 537/1048] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:16:48 2021] GET /identity/v3/projects/77afdeb59def454e98929fed403aa68f => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:48.419946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee943c3-ce00-4a66-b2ec-f9d1514c48ee admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:48.429044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee943c3-ce00-4a66-b2ec-f9d1514c48ee admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:48.433441 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38080b57-147c-4b72-bc95-7726cb0a8d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:48.434297 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080b57-147c-4b72-bc95-7726cb0a8d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:48.434578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080b57-147c-4b72-bc95-7726cb0a8d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:48.434892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080b57-147c-4b72-bc95-7726cb0a8d8d admin admin] PATH_INFO: `/v3/projects/77afdeb59def454e98929fed403aa68f/users/cdfadc90954540a0a1b2baa3a5c971b1/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:48.436791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38080b57-147c-4b72-bc95-7726cb0a8d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77afdeb59def454e98929fed403aa68f, user_id=cdfadc90954540a0a1b2baa3a5c971b1, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:48.439374 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38080b57-147c-4b72-bc95-7726cb0a8d8d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:48.452973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 512/1049] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:16:48 2021] PUT /identity/v3/projects/77afdeb59def454e98929fed403aa68f/users/cdfadc90954540a0a1b2baa3a5c971b1/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:16:50.548554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff407c-4fa5-484e-90f6-945e85cd8279 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:50.548977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff407c-4fa5-484e-90f6-945e85cd8279 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:50.549216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff407c-4fa5-484e-90f6-945e85cd8279 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:50.551504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 538/1050] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:50.557244 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ee80-6ead-4e9e-b422-c4d539fe90f2 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:50.557693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ee80-6ead-4e9e-b422-c4d539fe90f2 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:50.557799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ee80-6ead-4e9e-b422-c4d539fe90f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:50.574914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-0532ee80-6ead-4e9e-b422-c4d539fe90f2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:50.576083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0532ee80-6ead-4e9e-b422-c4d539fe90f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:50.630006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 513/1051] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:50.654448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff407c-4fa5-484e-90f6-945e85cd8279 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:50.666947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff407c-4fa5-484e-90f6-945e85cd8279 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:50.671276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab4999-40a8-448c-bab5-b251a32a4da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:50.672036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4999-40a8-448c-bab5-b251a32a4da6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:50.672325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4999-40a8-448c-bab5-b251a32a4da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:50.672602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4999-40a8-448c-bab5-b251a32a4da6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:50.683278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab4999-40a8-448c-bab5-b251a32a4da6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:16:50.690073 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-4eab4999-40a8-448c-bab5-b251a32a4da6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:16:50.691248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 539/1052] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:16:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:50.697421 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ee80-6ead-4e9e-b422-c4d539fe90f2 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:50.706454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ee80-6ead-4e9e-b422-c4d539fe90f2 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:50.710932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523025b-da88-441d-95b1-29513fd0e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:50.711565 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523025b-da88-441d-95b1-29513fd0e3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:50.711847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523025b-da88-441d-95b1-29513fd0e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:50.712124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523025b-da88-441d-95b1-29513fd0e3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:50.712858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523025b-da88-441d-95b1-29513fd0e3d8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:50.713163 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523025b-da88-441d-95b1-29513fd0e3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:50.714761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523025b-da88-441d-95b1-29513fd0e3d8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:50.723262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 514/1053] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:16:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:50.729090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab4999-40a8-448c-bab5-b251a32a4da6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:50.739348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab4999-40a8-448c-bab5-b251a32a4da6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:50.743787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8f44a-3728-4cab-a23d-296f3cff243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:50.744593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8f44a-3728-4cab-a23d-296f3cff243b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:50.744874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8f44a-3728-4cab-a23d-296f3cff243b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:50.745148 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8f44a-3728-4cab-a23d-296f3cff243b admin admin] PATH_INFO: `/v3/users/cdfadc90954540a0a1b2baa3a5c971b1` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:50.746313 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8f44a-3728-4cab-a23d-296f3cff243b admin admin] RBAC: Authorizing `identity:get_user(user_id=cdfadc90954540a0a1b2baa3a5c971b1)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:50.748460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8f44a-3728-4cab-a23d-296f3cff243b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:50.749981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 540/1054] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:16:50 2021] GET /identity/v3/users/cdfadc90954540a0a1b2baa3a5c971b1 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:50.755685 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523025b-da88-441d-95b1-29513fd0e3d8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:50.765115 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523025b-da88-441d-95b1-29513fd0e3d8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:50.769926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02501ab-2b95-4b7b-b1b9-067705c453b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:50.770527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02501ab-2b95-4b7b-b1b9-067705c453b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:50.771096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02501ab-2b95-4b7b-b1b9-067705c453b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:50.771374 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02501ab-2b95-4b7b-b1b9-067705c453b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:50.778784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02501ab-2b95-4b7b-b1b9-067705c453b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:50.780470 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02501ab-2b95-4b7b-b1b9-067705c453b2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:50.789512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 515/1055] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:50 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:50.795329 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8f44a-3728-4cab-a23d-296f3cff243b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:50.804359 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8f44a-3728-4cab-a23d-296f3cff243b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:50.808800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd4c4e-c1d2-43f2-adbb-73461f9faf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:50.809576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd4c4e-c1d2-43f2-adbb-73461f9faf74 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:50.809861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd4c4e-c1d2-43f2-adbb-73461f9faf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:50.810138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd4c4e-c1d2-43f2-adbb-73461f9faf74 admin admin] PATH_INFO: `/v3/projects/77afdeb59def454e98929fed403aa68f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:50.811286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd4c4e-c1d2-43f2-adbb-73461f9faf74 admin admin] RBAC: Authorizing `identity:get_project(project_id=77afdeb59def454e98929fed403aa68f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:50.813253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd4c4e-c1d2-43f2-adbb-73461f9faf74 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:50.814888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 541/1056] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:16:50 2021] GET /identity/v3/projects/77afdeb59def454e98929fed403aa68f => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:50.820813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02501ab-2b95-4b7b-b1b9-067705c453b2 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:50.832819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02501ab-2b95-4b7b-b1b9-067705c453b2 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:50.837353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c90d38-b0e8-4875-b884-404124142064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:50.837982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c90d38-b0e8-4875-b884-404124142064 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:50.838263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c90d38-b0e8-4875-b884-404124142064 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:50.838537 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c90d38-b0e8-4875-b884-404124142064 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:50.839390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c90d38-b0e8-4875-b884-404124142064 admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=77afdeb59def454e98929fed403aa68f, user.id=cdfadc90954540a0a1b2baa3a5c971b1) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:50.839696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c90d38-b0e8-4875-b884-404124142064 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:50.841503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c90d38-b0e8-4875-b884-404124142064 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:50.847788 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 516/1057] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:16:50 2021] GET /identity/v3/role_assignments?user.id=cdfadc90954540a0a1b2baa3a5c971b1&scope.project.id=77afdeb59def454e98929fed403aa68f&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:52.989336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6138d04-acad-4501-b52f-69fec67412ae None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:52.989862 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6138d04-acad-4501-b52f-69fec67412ae None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:52.989972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6138d04-acad-4501-b52f-69fec67412ae None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:52.991665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 542/1058] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:52.997506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e577e4-e82d-4b8f-ae08-194720c96546 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:52.997937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e577e4-e82d-4b8f-ae08-194720c96546 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:52.998042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e577e4-e82d-4b8f-ae08-194720c96546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:53.015585 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a4e577e4-e82d-4b8f-ae08-194720c96546 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:53.016751 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a4e577e4-e82d-4b8f-ae08-194720c96546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:53.024721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 517/1059] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:53.048001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6138d04-acad-4501-b52f-69fec67412ae None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:53.059830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6138d04-acad-4501-b52f-69fec67412ae None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:53.064122 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf1319-6ac8-4e9c-a8d0-7f34448b34fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:53.064767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1319-6ac8-4e9c-a8d0-7f34448b34fb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:53.065048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1319-6ac8-4e9c-a8d0-7f34448b34fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:53.065321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1319-6ac8-4e9c-a8d0-7f34448b34fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:53.072984 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf1319-6ac8-4e9c-a8d0-7f34448b34fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:53.075087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf1319-6ac8-4e9c-a8d0-7f34448b34fb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:53.084229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 543/1060] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:16:53 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:16:53.090454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e577e4-e82d-4b8f-ae08-194720c96546 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:53.099618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e577e4-e82d-4b8f-ae08-194720c96546 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:53.104011 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bfc8a-b839-414c-8b6f-23d605893842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:53.104781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bfc8a-b839-414c-8b6f-23d605893842 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:53.105058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bfc8a-b839-414c-8b6f-23d605893842 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:53.105331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bfc8a-b839-414c-8b6f-23d605893842 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:53.111925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bfc8a-b839-414c-8b6f-23d605893842 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:53.113710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bfc8a-b839-414c-8b6f-23d605893842 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:53.126724 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-0a0bfc8a-b839-414c-8b6f-23d605893842 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 25 01:16:53.127815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 518/1061] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 25 01:16:53 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:16:53.134255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf1319-6ac8-4e9c-a8d0-7f34448b34fb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:53.143614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf1319-6ac8-4e9c-a8d0-7f34448b34fb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:53.148339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3df32b-ee76-493e-b79c-0edb5a066103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:53.148972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3df32b-ee76-493e-b79c-0edb5a066103 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:53.149257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3df32b-ee76-493e-b79c-0edb5a066103 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:53.149535 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3df32b-ee76-493e-b79c-0edb5a066103 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:53.150251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3df32b-ee76-493e-b79c-0edb5a066103 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:16:53.150557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3df32b-ee76-493e-b79c-0edb5a066103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:53.152157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3df32b-ee76-493e-b79c-0edb5a066103 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:53.159802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 544/1062] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Aug 25 01:16:53 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:55.237583 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203f26f-3a49-495b-966d-d2c00d398f4f None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:55.238131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203f26f-3a49-495b-966d-d2c00d398f4f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:55.238131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203f26f-3a49-495b-966d-d2c00d398f4f None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:55.239910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 519/1063] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:55.246007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50d512-08c3-4c86-bee3-92769d70181a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:55.246432 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50d512-08c3-4c86-bee3-92769d70181a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:55.246565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50d512-08c3-4c86-bee3-92769d70181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:55.264568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-9c50d512-08c3-4c86-bee3-92769d70181a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:55.265760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9c50d512-08c3-4c86-bee3-92769d70181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:55.273337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 545/1064] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:55.296819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203f26f-3a49-495b-966d-d2c00d398f4f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:55.309028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203f26f-3a49-495b-966d-d2c00d398f4f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:55.313293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ff0d4-d817-4d9f-89f7-6d09d9278598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:55.313913 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff0d4-d817-4d9f-89f7-6d09d9278598 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:55.314191 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff0d4-d817-4d9f-89f7-6d09d9278598 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:55.315108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff0d4-d817-4d9f-89f7-6d09d9278598 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:55.315844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ff0d4-d817-4d9f-89f7-6d09d9278598 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:55.316827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-5e5ff0d4-d817-4d9f-89f7-6d09d9278598 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:16:55.316827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:16:55.316827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:16:55.317695 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ff0d4-d817-4d9f-89f7-6d09d9278598 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:55.331836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 520/1065] 10.222.0.23 () {60 vars in 1160 bytes} [Wed Aug 25 01:16:55 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:57.454292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae487882-f71a-4cc9-a7c9-d4de1490d6f7 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:57.454854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae487882-f71a-4cc9-a7c9-d4de1490d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:57.454854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae487882-f71a-4cc9-a7c9-d4de1490d6f7 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:57.457167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 546/1066] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:57.463899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50014c34-a5f8-4b05-a514-1d8d231aa5e7 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:57.464296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50014c34-a5f8-4b05-a514-1d8d231aa5e7 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:57.464448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50014c34-a5f8-4b05-a514-1d8d231aa5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:57.481614 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-50014c34-a5f8-4b05-a514-1d8d231aa5e7 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:57.482821 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-50014c34-a5f8-4b05-a514-1d8d231aa5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:57.537679 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 521/1067] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:57.562172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae487882-f71a-4cc9-a7c9-d4de1490d6f7 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:57.574760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae487882-f71a-4cc9-a7c9-d4de1490d6f7 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:57.579106 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d70e15-2981-459c-8cdf-fa368701c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:57.579942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d70e15-2981-459c-8cdf-fa368701c3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:57.580228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d70e15-2981-459c-8cdf-fa368701c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:57.580506 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d70e15-2981-459c-8cdf-fa368701c3d9 admin admin] PATH_INFO: `/v3/domains/362c8c96488d493f823cc79235bfd801` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:57.590910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d70e15-2981-459c-8cdf-fa368701c3d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=362c8c96488d493f823cc79235bfd801)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:57.592871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d70e15-2981-459c-8cdf-fa368701c3d9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:57.594428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 547/1068] 10.222.0.23 () {56 vars in 1205 bytes} [Wed Aug 25 01:16:57 2021] GET /identity/v3/domains/362c8c96488d493f823cc79235bfd801 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:57.600560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50014c34-a5f8-4b05-a514-1d8d231aa5e7 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:57.608988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50014c34-a5f8-4b05-a514-1d8d231aa5e7 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:57.613896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daf8ee-6df6-48e1-ac24-72ccb4a13f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:57.614522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daf8ee-6df6-48e1-ac24-72ccb4a13f86 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:57.614842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daf8ee-6df6-48e1-ac24-72ccb4a13f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:57.615118 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daf8ee-6df6-48e1-ac24-72ccb4a13f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:57.615798 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daf8ee-6df6-48e1-ac24-72ccb4a13f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:57.617650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daf8ee-6df6-48e1-ac24-72ccb4a13f86 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:57.642942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 522/1069] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:16:57 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:16:59.788360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbb523-d433-4f28-b3a3-e5f19982e351 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:59.788899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbb523-d433-4f28-b3a3-e5f19982e351 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:59.788899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbb523-d433-4f28-b3a3-e5f19982e351 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:59.790563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 548/1070] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:16:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:16:59.796341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd60ce-6a3b-4e9c-a9dc-0564f3e64227 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:59.796735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd60ce-6a3b-4e9c-a9dc-0564f3e64227 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:59.796898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd60ce-6a3b-4e9c-a9dc-0564f3e64227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:59.813813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-bbcd60ce-6a3b-4e9c-a9dc-0564f3e64227 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:16:59.815073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-bbcd60ce-6a3b-4e9c-a9dc-0564f3e64227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:16:59.869428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 523/1071] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:16:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:16:59.895349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbb523-d433-4f28-b3a3-e5f19982e351 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:59.907195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbb523-d433-4f28-b3a3-e5f19982e351 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:59.912062 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b980b99-6be6-4ae5-b1ac-fc59d0b44e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:59.912885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980b99-6be6-4ae5-b1ac-fc59d0b44e78 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:59.913166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980b99-6be6-4ae5-b1ac-fc59d0b44e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:59.913438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980b99-6be6-4ae5-b1ac-fc59d0b44e78 admin admin] PATH_INFO: `/v3/domains/362c8c96488d493f823cc79235bfd801` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:59.914566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b980b99-6be6-4ae5-b1ac-fc59d0b44e78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=362c8c96488d493f823cc79235bfd801)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:59.916519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b980b99-6be6-4ae5-b1ac-fc59d0b44e78 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:59.918028 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 549/1072] 10.222.0.23 () {56 vars in 1205 bytes} [Wed Aug 25 01:16:59 2021] GET /identity/v3/domains/362c8c96488d493f823cc79235bfd801 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:16:59.923923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd60ce-6a3b-4e9c-a9dc-0564f3e64227 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:16:59.932382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd60ce-6a3b-4e9c-a9dc-0564f3e64227 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:16:59.936947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96298a-67eb-4269-be53-26b9b81fc522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:16:59.937593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96298a-67eb-4269-be53-26b9b81fc522 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:16:59.937872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96298a-67eb-4269-be53-26b9b81fc522 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:16:59.938145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96298a-67eb-4269-be53-26b9b81fc522 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:16:59.938869 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96298a-67eb-4269-be53-26b9b81fc522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:16:59.940784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96298a-67eb-4269-be53-26b9b81fc522 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:16:59.959792 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 524/1073] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:16:59 2021] POST /identity/v3/users => generated 311 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:17:02.123688 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae4282-715a-455d-94bf-93e9ef56a766 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:02.124257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae4282-715a-455d-94bf-93e9ef56a766 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:02.124257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae4282-715a-455d-94bf-93e9ef56a766 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:02.125986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 550/1074] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:17:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:17:02.132520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a552-4b60-4b8b-b24c-668d5f2f9395 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:02.132937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a552-4b60-4b8b-b24c-668d5f2f9395 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:02.133082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a552-4b60-4b8b-b24c-668d5f2f9395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:02.150257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b7e3a552-4b60-4b8b-b24c-668d5f2f9395 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:17:02.151488 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b7e3a552-4b60-4b8b-b24c-668d5f2f9395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:17:02.158944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 525/1075] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:17:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:17:02.183580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae4282-715a-455d-94bf-93e9ef56a766 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:02.196067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae4282-715a-455d-94bf-93e9ef56a766 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:02.200349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793652d-641a-4e00-a3ac-9c604b970425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:02.201105 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793652d-641a-4e00-a3ac-9c604b970425 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:02.201387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793652d-641a-4e00-a3ac-9c604b970425 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:02.201663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793652d-641a-4e00-a3ac-9c604b970425 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:02.211966 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793652d-641a-4e00-a3ac-9c604b970425 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:17:02.218827 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-3793652d-641a-4e00-a3ac-9c604b970425 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:17:02.219945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 551/1076] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:17:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:17:02.226054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3a552-4b60-4b8b-b24c-668d5f2f9395 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:02.234593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3a552-4b60-4b8b-b24c-668d5f2f9395 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:02.239520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbeeea4-8fa2-4ea3-a348-6c5fd84d2077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:02.240157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeeea4-8fa2-4ea3-a348-6c5fd84d2077 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:02.240441 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeeea4-8fa2-4ea3-a348-6c5fd84d2077 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:02.240718 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeeea4-8fa2-4ea3-a348-6c5fd84d2077 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:02.241455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbeeea4-8fa2-4ea3-a348-6c5fd84d2077 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:17:02.241758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbeeea4-8fa2-4ea3-a348-6c5fd84d2077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:02.243367 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbeeea4-8fa2-4ea3-a348-6c5fd84d2077 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:02.251386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 526/1077] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:17:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:17:02.257693 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793652d-641a-4e00-a3ac-9c604b970425 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:02.267201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793652d-641a-4e00-a3ac-9c604b970425 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:02.271560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f01c21-6d8a-4fd7-a9e9-3577b5fbfeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:02.272374 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f01c21-6d8a-4fd7-a9e9-3577b5fbfeed admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:02.272655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f01c21-6d8a-4fd7-a9e9-3577b5fbfeed admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:02.272930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f01c21-6d8a-4fd7-a9e9-3577b5fbfeed admin admin] PATH_INFO: `/v3/users/82c6f59a93ff4224b938f801a8ac88be` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:02.285716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f01c21-6d8a-4fd7-a9e9-3577b5fbfeed admin admin] RBAC: Authorizing `identity:get_user(user_id=82c6f59a93ff4224b938f801a8ac88be)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:02.287882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f01c21-6d8a-4fd7-a9e9-3577b5fbfeed admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:02.289413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 552/1078] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:17:02 2021] GET /identity/v3/users/82c6f59a93ff4224b938f801a8ac88be => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:17:02.295363 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbeeea4-8fa2-4ea3-a348-6c5fd84d2077 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:02.304887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbeeea4-8fa2-4ea3-a348-6c5fd84d2077 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:02.309276 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77267af0-c699-47d3-b6ef-7083c3b2459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:02.309879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267af0-c699-47d3-b6ef-7083c3b2459b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:02.310160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267af0-c699-47d3-b6ef-7083c3b2459b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:02.310433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267af0-c699-47d3-b6ef-7083c3b2459b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:02.318445 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77267af0-c699-47d3-b6ef-7083c3b2459b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:02.320176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77267af0-c699-47d3-b6ef-7083c3b2459b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:02.328675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 527/1079] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:17:02 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:17:02.334543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f01c21-6d8a-4fd7-a9e9-3577b5fbfeed admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:02.343626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f01c21-6d8a-4fd7-a9e9-3577b5fbfeed admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:02.348615 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d256f50-7973-4ca4-9850-d2bab401b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:02.349415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d256f50-7973-4ca4-9850-d2bab401b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:02.349696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d256f50-7973-4ca4-9850-d2bab401b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:02.349974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d256f50-7973-4ca4-9850-d2bab401b8cf admin admin] PATH_INFO: `/v3/projects/cc261b49906c4930a345503272d9b675` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:02.351130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d256f50-7973-4ca4-9850-d2bab401b8cf admin admin] RBAC: Authorizing `identity:get_project(project_id=cc261b49906c4930a345503272d9b675)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:02.353113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d256f50-7973-4ca4-9850-d2bab401b8cf admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:02.354818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 553/1080] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:17:02 2021] GET /identity/v3/projects/cc261b49906c4930a345503272d9b675 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:17:02.360574 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77267af0-c699-47d3-b6ef-7083c3b2459b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:02.369323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77267af0-c699-47d3-b6ef-7083c3b2459b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:02.373666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ed136-d2c8-4148-adfe-73fa310c7149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:02.374304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ed136-d2c8-4148-adfe-73fa310c7149 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:02.374535 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ed136-d2c8-4148-adfe-73fa310c7149 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:02.374847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ed136-d2c8-4148-adfe-73fa310c7149 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:02.375646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ed136-d2c8-4148-adfe-73fa310c7149 admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=cc261b49906c4930a345503272d9b675, user.id=82c6f59a93ff4224b938f801a8ac88be) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:17:02.375952 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ed136-d2c8-4148-adfe-73fa310c7149 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:02.377692 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ed136-d2c8-4148-adfe-73fa310c7149 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:02.382761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 528/1081] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:17:02 2021] GET /identity/v3/role_assignments?user.id=82c6f59a93ff4224b938f801a8ac88be&scope.project.id=cc261b49906c4930a345503272d9b675&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:17:04.467308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28655fb-247c-4d2a-9038-43caccb2109a None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:04.467861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28655fb-247c-4d2a-9038-43caccb2109a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:04.467861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28655fb-247c-4d2a-9038-43caccb2109a None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:04.469625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 554/1082] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:17:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:17:04.475574 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b798cf9-8549-47b8-8786-9a79240bceaa None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:04.475994 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b798cf9-8549-47b8-8786-9a79240bceaa None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:04.476133 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b798cf9-8549-47b8-8786-9a79240bceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:04.493920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-0b798cf9-8549-47b8-8786-9a79240bceaa None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:17:04.495146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0b798cf9-8549-47b8-8786-9a79240bceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:17:04.503314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 529/1083] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:17:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:17:04.527039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28655fb-247c-4d2a-9038-43caccb2109a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:04.539170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28655fb-247c-4d2a-9038-43caccb2109a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:04.543497 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef984-f207-44c3-9b95-bb0d040a9957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:04.544272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef984-f207-44c3-9b95-bb0d040a9957 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:04.544563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef984-f207-44c3-9b95-bb0d040a9957 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:04.544952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef984-f207-44c3-9b95-bb0d040a9957 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:04.555406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef984-f207-44c3-9b95-bb0d040a9957 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:17:04.562124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-bf2ef984-f207-44c3-9b95-bb0d040a9957 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:17:04.563287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 555/1084] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:17:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:17:04.570013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b798cf9-8549-47b8-8786-9a79240bceaa None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:04.578604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b798cf9-8549-47b8-8786-9a79240bceaa None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:04.583047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d589cfd-4c7d-483a-a357-5fbda2a65dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:04.583691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d589cfd-4c7d-483a-a357-5fbda2a65dfb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:04.583976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d589cfd-4c7d-483a-a357-5fbda2a65dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:04.584253 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d589cfd-4c7d-483a-a357-5fbda2a65dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:04.584997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d589cfd-4c7d-483a-a357-5fbda2a65dfb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:17:04.585305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d589cfd-4c7d-483a-a357-5fbda2a65dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:04.586920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d589cfd-4c7d-483a-a357-5fbda2a65dfb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:04.594833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 530/1085] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:17:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:17:04.601096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef984-f207-44c3-9b95-bb0d040a9957 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:04.610724 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef984-f207-44c3-9b95-bb0d040a9957 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:04.615773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fba36-32d9-47f6-bea7-43a70b049575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:04.616580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fba36-32d9-47f6-bea7-43a70b049575 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:04.616864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fba36-32d9-47f6-bea7-43a70b049575 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:04.617140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fba36-32d9-47f6-bea7-43a70b049575 admin admin] PATH_INFO: `/v3/users/82c6f59a93ff4224b938f801a8ac88be` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:04.618279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fba36-32d9-47f6-bea7-43a70b049575 admin admin] RBAC: Authorizing `identity:get_user(user_id=82c6f59a93ff4224b938f801a8ac88be)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:04.620485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fba36-32d9-47f6-bea7-43a70b049575 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:04.622008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 556/1086] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:17:04 2021] GET /identity/v3/users/82c6f59a93ff4224b938f801a8ac88be => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:17:04.627779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d589cfd-4c7d-483a-a357-5fbda2a65dfb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:04.636847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d589cfd-4c7d-483a-a357-5fbda2a65dfb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:04.641420 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7435f6e-84d0-463d-9c96-4599d0c881b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:04.642221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7435f6e-84d0-463d-9c96-4599d0c881b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:04.642501 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7435f6e-84d0-463d-9c96-4599d0c881b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:04.642803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7435f6e-84d0-463d-9c96-4599d0c881b2 admin admin] PATH_INFO: `/v3/projects/cc261b49906c4930a345503272d9b675` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:04.643931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7435f6e-84d0-463d-9c96-4599d0c881b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=cc261b49906c4930a345503272d9b675)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:04.645899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7435f6e-84d0-463d-9c96-4599d0c881b2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:04.647495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 531/1087] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:17:04 2021] GET /identity/v3/projects/cc261b49906c4930a345503272d9b675 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:17:04.653370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fba36-32d9-47f6-bea7-43a70b049575 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:04.662997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fba36-32d9-47f6-bea7-43a70b049575 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:04.667416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7484c-952f-4ba7-9cbc-7082b3d534df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:04.668244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7484c-952f-4ba7-9cbc-7082b3d534df admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:04.668525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7484c-952f-4ba7-9cbc-7082b3d534df admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:04.668801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7484c-952f-4ba7-9cbc-7082b3d534df admin admin] PATH_INFO: `/v3/projects/cc261b49906c4930a345503272d9b675/users/82c6f59a93ff4224b938f801a8ac88be/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:04.670707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7484c-952f-4ba7-9cbc-7082b3d534df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc261b49906c4930a345503272d9b675, user_id=82c6f59a93ff4224b938f801a8ac88be, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:04.673266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7484c-952f-4ba7-9cbc-7082b3d534df admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:04.686016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 557/1088] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:17:04 2021] PUT /identity/v3/projects/cc261b49906c4930a345503272d9b675/users/82c6f59a93ff4224b938f801a8ac88be/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:17:06.785311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1ca1-8338-4757-bb37-4fd203c6a349 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:06.785831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1ca1-8338-4757-bb37-4fd203c6a349 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:06.785831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1ca1-8338-4757-bb37-4fd203c6a349 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:06.787571 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 532/1089] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:17:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:17:06.793494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfcba-f6e8-4832-a742-e062ed7fc3f2 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:06.793934 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfcba-f6e8-4832-a742-e062ed7fc3f2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:06.794056 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfcba-f6e8-4832-a742-e062ed7fc3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:06.811181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2f1cfcba-f6e8-4832-a742-e062ed7fc3f2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:17:06.812353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2f1cfcba-f6e8-4832-a742-e062ed7fc3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:17:06.866886 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 558/1090] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:17:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:17:06.891762 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a1ca1-8338-4757-bb37-4fd203c6a349 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:06.904027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a1ca1-8338-4757-bb37-4fd203c6a349 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:06.908314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6466f63-d051-46fe-b57d-d746893aeb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:06.909073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466f63-d051-46fe-b57d-d746893aeb17 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:06.909353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466f63-d051-46fe-b57d-d746893aeb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:06.909625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466f63-d051-46fe-b57d-d746893aeb17 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:06.919303 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6466f63-d051-46fe-b57d-d746893aeb17 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:17:06.926086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-e6466f63-d051-46fe-b57d-d746893aeb17 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:17:06.927226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 533/1091] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:17:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:17:06.933450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cfcba-f6e8-4832-a742-e062ed7fc3f2 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:06.942585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cfcba-f6e8-4832-a742-e062ed7fc3f2 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:06.947024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c46ae-4cad-4a4d-9101-b4f19c546c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:06.947670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c46ae-4cad-4a4d-9101-b4f19c546c30 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:06.947953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c46ae-4cad-4a4d-9101-b4f19c546c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:06.948227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c46ae-4cad-4a4d-9101-b4f19c546c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:06.948955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c46ae-4cad-4a4d-9101-b4f19c546c30 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:17:06.949260 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c46ae-4cad-4a4d-9101-b4f19c546c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:06.950872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c46ae-4cad-4a4d-9101-b4f19c546c30 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:06.959454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 559/1092] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:17:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:17:06.965472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6466f63-d051-46fe-b57d-d746893aeb17 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:06.975151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6466f63-d051-46fe-b57d-d746893aeb17 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:06.979531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ef44e-9809-4ff4-a2f5-dd9324b6960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:06.980345 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ef44e-9809-4ff4-a2f5-dd9324b6960e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:06.980622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ef44e-9809-4ff4-a2f5-dd9324b6960e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:06.980895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ef44e-9809-4ff4-a2f5-dd9324b6960e admin admin] PATH_INFO: `/v3/users/82c6f59a93ff4224b938f801a8ac88be` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:06.982036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ef44e-9809-4ff4-a2f5-dd9324b6960e admin admin] RBAC: Authorizing `identity:get_user(user_id=82c6f59a93ff4224b938f801a8ac88be)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:06.984149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ef44e-9809-4ff4-a2f5-dd9324b6960e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:06.985657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 534/1093] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:17:06 2021] GET /identity/v3/users/82c6f59a93ff4224b938f801a8ac88be => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:17:06.991474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c46ae-4cad-4a4d-9101-b4f19c546c30 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:07.000639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c46ae-4cad-4a4d-9101-b4f19c546c30 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:07.005610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf1f42-dc03-4696-b4be-184d0da3e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:07.006229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf1f42-dc03-4696-b4be-184d0da3e59e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:07.006515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf1f42-dc03-4696-b4be-184d0da3e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:07.006839 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf1f42-dc03-4696-b4be-184d0da3e59e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:07.014597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf1f42-dc03-4696-b4be-184d0da3e59e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:07.016321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf1f42-dc03-4696-b4be-184d0da3e59e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:07.025593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 560/1094] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:17:06 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:17:07.031426 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ef44e-9809-4ff4-a2f5-dd9324b6960e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:07.040556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ef44e-9809-4ff4-a2f5-dd9324b6960e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:07.044892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a785b0-ccda-4285-8dcc-6138a477bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:07.045681 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a785b0-ccda-4285-8dcc-6138a477bb2d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:07.045964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a785b0-ccda-4285-8dcc-6138a477bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:07.046241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a785b0-ccda-4285-8dcc-6138a477bb2d admin admin] PATH_INFO: `/v3/projects/cc261b49906c4930a345503272d9b675` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:07.047363 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a785b0-ccda-4285-8dcc-6138a477bb2d admin admin] RBAC: Authorizing `identity:get_project(project_id=cc261b49906c4930a345503272d9b675)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:07.049350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a785b0-ccda-4285-8dcc-6138a477bb2d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:07.050956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 535/1095] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:17:07 2021] GET /identity/v3/projects/cc261b49906c4930a345503272d9b675 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:17:07.057023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf1f42-dc03-4696-b4be-184d0da3e59e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:17:07.065819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf1f42-dc03-4696-b4be-184d0da3e59e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:17:07.070398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad52acc-4480-47b8-9b0f-10e962f25074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:17:07.071041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad52acc-4480-47b8-9b0f-10e962f25074 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:17:07.071326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad52acc-4480-47b8-9b0f-10e962f25074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:17:07.071603 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad52acc-4480-47b8-9b0f-10e962f25074 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:17:07.072402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad52acc-4480-47b8-9b0f-10e962f25074 admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=cc261b49906c4930a345503272d9b675, user.id=82c6f59a93ff4224b938f801a8ac88be) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:17:07.072715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad52acc-4480-47b8-9b0f-10e962f25074 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:17:07.074488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad52acc-4480-47b8-9b0f-10e962f25074 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:17:07.080608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 561/1096] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:17:07 2021] GET /identity/v3/role_assignments?user.id=82c6f59a93ff4224b938f801a8ac88be&scope.project.id=cc261b49906c4930a345503272d9b675&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:01.518632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe401cc-3e3a-4ef8-8cac-f51c123c2b54 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:01.519282 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe401cc-3e3a-4ef8-8cac-f51c123c2b54 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:01.519282 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe401cc-3e3a-4ef8-8cac-f51c123c2b54 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:01.521195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 536/1097] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:18:01.527978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001af1a2-93fa-4bea-ace3-9c461fafae12 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:01.528454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001af1a2-93fa-4bea-ace3-9c461fafae12 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:01.528710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001af1a2-93fa-4bea-ace3-9c461fafae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:01.548459 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-001af1a2-93fa-4bea-ace3-9c461fafae12 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:01.549687 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-001af1a2-93fa-4bea-ace3-9c461fafae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:01.559118 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 562/1098] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:18:01.587407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe401cc-3e3a-4ef8-8cac-f51c123c2b54 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:01.602581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe401cc-3e3a-4ef8-8cac-f51c123c2b54 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:01.607733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17c950-df2b-487e-9c24-e640af99beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:01.608507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17c950-df2b-487e-9c24-e640af99beb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:01.608842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17c950-df2b-487e-9c24-e640af99beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:01.609821 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17c950-df2b-487e-9c24-e640af99beb1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:01.621787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17c950-df2b-487e-9c24-e640af99beb1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:01.624006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17c950-df2b-487e-9c24-e640af99beb1 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:01.642931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-4a17c950-df2b-487e-9c24-e640af99beb1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:01.644326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 537/1099] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:01.654714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001af1a2-93fa-4bea-ace3-9c461fafae12 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:01.662299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001af1a2-93fa-4bea-ace3-9c461fafae12 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:01.667199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0b8e-4759-4512-ac84-c72c57343d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:01.667937 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0b8e-4759-4512-ac84-c72c57343d3b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:01.668213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0b8e-4759-4512-ac84-c72c57343d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:01.668515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0b8e-4759-4512-ac84-c72c57343d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:01.669282 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0b8e-4759-4512-ac84-c72c57343d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:01.669632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0b8e-4759-4512-ac84-c72c57343d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:01.671337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0b8e-4759-4512-ac84-c72c57343d3b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:01.685226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 563/1100] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:01.692635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17c950-df2b-487e-9c24-e640af99beb1 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:01.706191 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17c950-df2b-487e-9c24-e640af99beb1 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:01.711709 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a6904-0e19-442f-9f92-7bee79977496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:01.712443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a6904-0e19-442f-9f92-7bee79977496 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:01.712797 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a6904-0e19-442f-9f92-7bee79977496 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:01.713078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a6904-0e19-442f-9f92-7bee79977496 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:01.713856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a6904-0e19-442f-9f92-7bee79977496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:01.716003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a6904-0e19-442f-9f92-7bee79977496 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:01.741426 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 538/1101] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Aug 25 01:18:01 2021] POST /identity/v3/users => generated 251 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:18:04.185050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13ff6e-d37a-4860-966c-c75825a63465 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.185664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13ff6e-d37a-4860-966c-c75825a63465 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.185664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13ff6e-d37a-4860-966c-c75825a63465 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.187845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 564/1102] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:18:04.194153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4a89-cb4d-4ae4-a45e-d75303bc0203 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.194626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4a89-cb4d-4ae4-a45e-d75303bc0203 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.194745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4a89-cb4d-4ae4-a45e-d75303bc0203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.214262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-84fa4a89-cb4d-4ae4-a45e-d75303bc0203 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:04.215776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-84fa4a89-cb4d-4ae4-a45e-d75303bc0203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:04.226940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 539/1103] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:18:04.253419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13ff6e-d37a-4860-966c-c75825a63465 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.266610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13ff6e-d37a-4860-966c-c75825a63465 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.272915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d566b0d-5855-497c-88fe-dde8d2107576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.273840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d566b0d-5855-497c-88fe-dde8d2107576 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.274210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d566b0d-5855-497c-88fe-dde8d2107576 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.274560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d566b0d-5855-497c-88fe-dde8d2107576 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.288263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d566b0d-5855-497c-88fe-dde8d2107576 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:18:04.295723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-2d566b0d-5855-497c-88fe-dde8d2107576 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:18:04.297371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 565/1104] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:04.303938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa4a89-cb4d-4ae4-a45e-d75303bc0203 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.313496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa4a89-cb4d-4ae4-a45e-d75303bc0203 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.318223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6255d-7eee-47c9-8f78-dcc0128c3908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.318899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6255d-7eee-47c9-8f78-dcc0128c3908 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.319239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6255d-7eee-47c9-8f78-dcc0128c3908 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.319521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6255d-7eee-47c9-8f78-dcc0128c3908 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.320262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6255d-7eee-47c9-8f78-dcc0128c3908 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:04.320563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6255d-7eee-47c9-8f78-dcc0128c3908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.322128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6255d-7eee-47c9-8f78-dcc0128c3908 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.330915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 540/1105] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:04.337410 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d566b0d-5855-497c-88fe-dde8d2107576 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.348184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d566b0d-5855-497c-88fe-dde8d2107576 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.353156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5291c-7451-48fb-b24f-e136e9d48bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.353782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5291c-7451-48fb-b24f-e136e9d48bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.354019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5291c-7451-48fb-b24f-e136e9d48bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.354293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5291c-7451-48fb-b24f-e136e9d48bd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.365075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5291c-7451-48fb-b24f-e136e9d48bd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.366932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5291c-7451-48fb-b24f-e136e9d48bd5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.387402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-e9b5291c-7451-48fb-b24f-e136e9d48bd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:04.388585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 566/1106] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:04.395530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6255d-7eee-47c9-8f78-dcc0128c3908 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.405456 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6255d-7eee-47c9-8f78-dcc0128c3908 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.411763 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d814f1-5f55-409e-8863-79ed0e61c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.412626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d814f1-5f55-409e-8863-79ed0e61c82c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.413063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d814f1-5f55-409e-8863-79ed0e61c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.413406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d814f1-5f55-409e-8863-79ed0e61c82c admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.414343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d814f1-5f55-409e-8863-79ed0e61c82c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:04.414744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d814f1-5f55-409e-8863-79ed0e61c82c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.416442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d814f1-5f55-409e-8863-79ed0e61c82c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.434263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 541/1107] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:04.435409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5291c-7451-48fb-b24f-e136e9d48bd5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.446309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5291c-7451-48fb-b24f-e136e9d48bd5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.451228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de776a98-f5aa-4bb8-b053-131f67628c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.452142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de776a98-f5aa-4bb8-b053-131f67628c03 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.452551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de776a98-f5aa-4bb8-b053-131f67628c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.453357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de776a98-f5aa-4bb8-b053-131f67628c03 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.461410 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de776a98-f5aa-4bb8-b053-131f67628c03 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.463484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de776a98-f5aa-4bb8-b053-131f67628c03 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.478090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-de776a98-f5aa-4bb8-b053-131f67628c03 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 01:18:04.479424 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 567/1108] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:18:04.489204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d814f1-5f55-409e-8863-79ed0e61c82c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.499830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d814f1-5f55-409e-8863-79ed0e61c82c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.505186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202961f-abf7-4366-9d61-fc2d533fde38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.505863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202961f-abf7-4366-9d61-fc2d533fde38 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.506147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202961f-abf7-4366-9d61-fc2d533fde38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.506416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202961f-abf7-4366-9d61-fc2d533fde38 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.507282 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202961f-abf7-4366-9d61-fc2d533fde38 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:04.507590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202961f-abf7-4366-9d61-fc2d533fde38 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.509469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202961f-abf7-4366-9d61-fc2d533fde38 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.528364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 542/1109] 10.222.0.23 () {56 vars in 1165 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:04.535486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de776a98-f5aa-4bb8-b053-131f67628c03 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.545047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de776a98-f5aa-4bb8-b053-131f67628c03 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.549730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3884e-9456-4e3b-a005-9f6ecfb53183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.550329 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3884e-9456-4e3b-a005-9f6ecfb53183 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.550610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3884e-9456-4e3b-a005-9f6ecfb53183 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.550982 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3884e-9456-4e3b-a005-9f6ecfb53183 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.559129 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3884e-9456-4e3b-a005-9f6ecfb53183 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.560871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3884e-9456-4e3b-a005-9f6ecfb53183 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.572405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 568/1110] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:18:04.576994 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202961f-abf7-4366-9d61-fc2d533fde38 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.588829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202961f-abf7-4366-9d61-fc2d533fde38 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.594228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995bd35-bb49-422b-96b6-f371e33a1f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.595226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995bd35-bb49-422b-96b6-f371e33a1f6d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.595644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995bd35-bb49-422b-96b6-f371e33a1f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.596047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995bd35-bb49-422b-96b6-f371e33a1f6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.607058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995bd35-bb49-422b-96b6-f371e33a1f6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.609039 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995bd35-bb49-422b-96b6-f371e33a1f6d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.628356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-8995bd35-bb49-422b-96b6-f371e33a1f6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:04.631923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 543/1111] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:18:04.636091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3884e-9456-4e3b-a005-9f6ecfb53183 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.646844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3884e-9456-4e3b-a005-9f6ecfb53183 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.652192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373f6de-396b-4c4e-9f5b-8778713a962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.653040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373f6de-396b-4c4e-9f5b-8778713a962d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.653536 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373f6de-396b-4c4e-9f5b-8778713a962d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.654128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373f6de-396b-4c4e-9f5b-8778713a962d admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.655062 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373f6de-396b-4c4e-9f5b-8778713a962d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:04.655415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373f6de-396b-4c4e-9f5b-8778713a962d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.657376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373f6de-396b-4c4e-9f5b-8778713a962d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.669652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 569/1112] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:04.675899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995bd35-bb49-422b-96b6-f371e33a1f6d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.686008 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995bd35-bb49-422b-96b6-f371e33a1f6d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.691428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bb6f2-8373-49fc-9424-5b6e2311edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.693538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb6f2-8373-49fc-9424-5b6e2311edce admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.693538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb6f2-8373-49fc-9424-5b6e2311edce admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.693538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bb6f2-8373-49fc-9424-5b6e2311edce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.700618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bb6f2-8373-49fc-9424-5b6e2311edce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.703315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bb6f2-8373-49fc-9424-5b6e2311edce admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.718140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-5e7bb6f2-8373-49fc-9424-5b6e2311edce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:18:04.719644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 544/1113] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:18:04.726115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373f6de-396b-4c4e-9f5b-8778713a962d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.737046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373f6de-396b-4c4e-9f5b-8778713a962d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.742322 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98109ecf-b725-4f50-b227-5a213978d547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.743100 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98109ecf-b725-4f50-b227-5a213978d547 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.743427 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98109ecf-b725-4f50-b227-5a213978d547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.743754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98109ecf-b725-4f50-b227-5a213978d547 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.744601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98109ecf-b725-4f50-b227-5a213978d547 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:04.744945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98109ecf-b725-4f50-b227-5a213978d547 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.747345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98109ecf-b725-4f50-b227-5a213978d547 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.761831 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 570/1114] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:18:04.768960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bb6f2-8373-49fc-9424-5b6e2311edce admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:04.779751 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bb6f2-8373-49fc-9424-5b6e2311edce admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:04.785082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ce407-730d-49c9-9434-e14bedb643e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:04.785879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce407-730d-49c9-9434-e14bedb643e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:04.786203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce407-730d-49c9-9434-e14bedb643e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:04.786589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce407-730d-49c9-9434-e14bedb643e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:04.787705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ce407-730d-49c9-9434-e14bedb643e3 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=40b49222a8e4474bbe14019418ec8aa6) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:04.788700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ce407-730d-49c9-9434-e14bedb643e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:04.790311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ce407-730d-49c9-9434-e14bedb643e3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:04.796982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 545/1115] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:18:04 2021] GET /identity/v3/role_assignments?user.id=40b49222a8e4474bbe14019418ec8aa6&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:07.188656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e78bdd-6623-42de-89af-e00552dd69fa None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.189257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e78bdd-6623-42de-89af-e00552dd69fa None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.189366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e78bdd-6623-42de-89af-e00552dd69fa None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.191738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 571/1116] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:18:07.198230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e906f-7a81-434f-a3bf-6a768e0b76d0 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.198662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e906f-7a81-434f-a3bf-6a768e0b76d0 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.198802 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e906f-7a81-434f-a3bf-6a768e0b76d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.216333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-8d3e906f-7a81-434f-a3bf-6a768e0b76d0 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:07.217527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8d3e906f-7a81-434f-a3bf-6a768e0b76d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:07.226521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 546/1117] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:18:07.250456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e78bdd-6623-42de-89af-e00552dd69fa None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.265902 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e78bdd-6623-42de-89af-e00552dd69fa None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.270655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7ef15-6cfa-4aa7-885e-31459dbe8ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.271475 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7ef15-6cfa-4aa7-885e-31459dbe8ecd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.271759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7ef15-6cfa-4aa7-885e-31459dbe8ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.272029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7ef15-6cfa-4aa7-885e-31459dbe8ecd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.283622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7ef15-6cfa-4aa7-885e-31459dbe8ecd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:18:07.292508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-9ac7ef15-6cfa-4aa7-885e-31459dbe8ecd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:18:07.293997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 572/1118] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:18:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:07.301161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e906f-7a81-434f-a3bf-6a768e0b76d0 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.310236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e906f-7a81-434f-a3bf-6a768e0b76d0 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.315518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f549c-e4fa-4d0f-aae7-4160b303dbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.316202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f549c-e4fa-4d0f-aae7-4160b303dbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.316445 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f549c-e4fa-4d0f-aae7-4160b303dbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.316744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f549c-e4fa-4d0f-aae7-4160b303dbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.317467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f549c-e4fa-4d0f-aae7-4160b303dbd5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:07.317779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f549c-e4fa-4d0f-aae7-4160b303dbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:07.319602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f549c-e4fa-4d0f-aae7-4160b303dbd5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:07.328596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 547/1119] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:18:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:07.335749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7ef15-6cfa-4aa7-885e-31459dbe8ecd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.347463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7ef15-6cfa-4aa7-885e-31459dbe8ecd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.352246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ec7c6-df66-4ae5-8f6d-bf85126e2ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.353009 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ec7c6-df66-4ae5-8f6d-bf85126e2ffd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.353313 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ec7c6-df66-4ae5-8f6d-bf85126e2ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.353562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ec7c6-df66-4ae5-8f6d-bf85126e2ffd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.363786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ec7c6-df66-4ae5-8f6d-bf85126e2ffd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:07.365769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ec7c6-df66-4ae5-8f6d-bf85126e2ffd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:07.382234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-218ec7c6-df66-4ae5-8f6d-bf85126e2ffd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:07.383478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 573/1120] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:18:07.391686 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f549c-e4fa-4d0f-aae7-4160b303dbd5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.402837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f549c-e4fa-4d0f-aae7-4160b303dbd5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.408368 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f5d2e-5a74-4858-ba5c-6265eb578289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.409215 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f5d2e-5a74-4858-ba5c-6265eb578289 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.409502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f5d2e-5a74-4858-ba5c-6265eb578289 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.409785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f5d2e-5a74-4858-ba5c-6265eb578289 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.410512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f5d2e-5a74-4858-ba5c-6265eb578289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:07.410855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f5d2e-5a74-4858-ba5c-6265eb578289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:07.412619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f5d2e-5a74-4858-ba5c-6265eb578289 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:07.427510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 548/1121] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:07.434246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ec7c6-df66-4ae5-8f6d-bf85126e2ffd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.445006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ec7c6-df66-4ae5-8f6d-bf85126e2ffd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.451240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a585f-f886-4508-a9a9-ffdb188a2b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.452036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a585f-f886-4508-a9a9-ffdb188a2b58 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.452304 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a585f-f886-4508-a9a9-ffdb188a2b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.453091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a585f-f886-4508-a9a9-ffdb188a2b58 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.460787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a585f-f886-4508-a9a9-ffdb188a2b58 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:07.462842 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a585f-f886-4508-a9a9-ffdb188a2b58 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:07.477510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-994a585f-f886-4508-a9a9-ffdb188a2b58 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 01:18:07.478670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 574/1122] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:07 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:07.486830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f5d2e-5a74-4858-ba5c-6265eb578289 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.497481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f5d2e-5a74-4858-ba5c-6265eb578289 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.502950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fd58-8ddb-42e6-bf58-076e52ef3539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.503631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fd58-8ddb-42e6-bf58-076e52ef3539 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.503886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fd58-8ddb-42e6-bf58-076e52ef3539 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.504205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fd58-8ddb-42e6-bf58-076e52ef3539 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.504987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9fd58-8ddb-42e6-bf58-076e52ef3539 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:07.505293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9fd58-8ddb-42e6-bf58-076e52ef3539 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:07.507162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9fd58-8ddb-42e6-bf58-076e52ef3539 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:07.526053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 549/1123] 10.222.0.23 () {56 vars in 1165 bytes} [Wed Aug 25 01:18:07 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:07.533238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a585f-f886-4508-a9a9-ffdb188a2b58 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.543132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a585f-f886-4508-a9a9-ffdb188a2b58 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.547720 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf9808-26da-42d7-8792-fefe9df5f50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.548531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf9808-26da-42d7-8792-fefe9df5f50f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.548846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf9808-26da-42d7-8792-fefe9df5f50f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.549048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf9808-26da-42d7-8792-fefe9df5f50f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.559862 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf9808-26da-42d7-8792-fefe9df5f50f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:07.562970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf9808-26da-42d7-8792-fefe9df5f50f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:07.584303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-9eaf9808-26da-42d7-8792-fefe9df5f50f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:07.585780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 575/1124] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:07.592574 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fd58-8ddb-42e6-bf58-076e52ef3539 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.602309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fd58-8ddb-42e6-bf58-076e52ef3539 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.607121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e608063-c117-4ff8-bf47-1ae073dfc3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.607763 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e608063-c117-4ff8-bf47-1ae073dfc3ea admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.608041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e608063-c117-4ff8-bf47-1ae073dfc3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.608313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e608063-c117-4ff8-bf47-1ae073dfc3ea admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.609045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e608063-c117-4ff8-bf47-1ae073dfc3ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:07.609344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e608063-c117-4ff8-bf47-1ae073dfc3ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:07.610944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e608063-c117-4ff8-bf47-1ae073dfc3ea admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:07.622514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 550/1125] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:07.629596 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf9808-26da-42d7-8792-fefe9df5f50f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.642562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf9808-26da-42d7-8792-fefe9df5f50f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.647790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c19a2-db78-42b2-9ef5-c4c83cb1105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.648766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c19a2-db78-42b2-9ef5-c4c83cb1105e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.649183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c19a2-db78-42b2-9ef5-c4c83cb1105e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.649519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c19a2-db78-42b2-9ef5-c4c83cb1105e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.656983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c19a2-db78-42b2-9ef5-c4c83cb1105e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:07.659657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c19a2-db78-42b2-9ef5-c4c83cb1105e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:07.676301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-f50c19a2-db78-42b2-9ef5-c4c83cb1105e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:18:07.677614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 576/1126] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:18:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:07.684291 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e608063-c117-4ff8-bf47-1ae073dfc3ea admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.697834 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e608063-c117-4ff8-bf47-1ae073dfc3ea admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.703390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92d57e-dc6a-4bb6-b29f-3a77f508e0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.704029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d57e-dc6a-4bb6-b29f-3a77f508e0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.704317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d57e-dc6a-4bb6-b29f-3a77f508e0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.704622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92d57e-dc6a-4bb6-b29f-3a77f508e0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.705479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92d57e-dc6a-4bb6-b29f-3a77f508e0f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:07.705827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92d57e-dc6a-4bb6-b29f-3a77f508e0f9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:07.707991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92d57e-dc6a-4bb6-b29f-3a77f508e0f9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:07.729746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 551/1127] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:18:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:07.730935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c19a2-db78-42b2-9ef5-c4c83cb1105e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:07.742078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c19a2-db78-42b2-9ef5-c4c83cb1105e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:07.747198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16480ac5-d74f-420c-8477-80540649e782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:07.748166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16480ac5-d74f-420c-8477-80540649e782 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:07.748471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16480ac5-d74f-420c-8477-80540649e782 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:07.748789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16480ac5-d74f-420c-8477-80540649e782 admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/40b49222a8e4474bbe14019418ec8aa6/roles/a7290d45b88b4a14ab8a17f724c7adf9` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:07.764779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16480ac5-d74f-420c-8477-80540649e782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=40b49222a8e4474bbe14019418ec8aa6, role_id=a7290d45b88b4a14ab8a17f724c7adf9)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:07.768434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16480ac5-d74f-420c-8477-80540649e782 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:07.784098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 577/1128] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:18:07 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/40b49222a8e4474bbe14019418ec8aa6/roles/a7290d45b88b4a14ab8a17f724c7adf9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:18:09.893090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317db675-8544-4ffb-8972-9e19b580f1f6 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:09.893684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317db675-8544-4ffb-8972-9e19b580f1f6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:09.893684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317db675-8544-4ffb-8972-9e19b580f1f6 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:09.895362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 552/1129] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:18:09.902051 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61d688-9a95-434e-9a17-acfd585eaa7b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:09.902510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61d688-9a95-434e-9a17-acfd585eaa7b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:09.902619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61d688-9a95-434e-9a17-acfd585eaa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:09.922804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-1a61d688-9a95-434e-9a17-acfd585eaa7b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:09.924010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1a61d688-9a95-434e-9a17-acfd585eaa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:09.981647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 578/1130] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:18:10.006380 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317db675-8544-4ffb-8972-9e19b580f1f6 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.018912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317db675-8544-4ffb-8972-9e19b580f1f6 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.023472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf8d26-056c-47ea-9763-8a02f745dc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.024235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf8d26-056c-47ea-9763-8a02f745dc98 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.024519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf8d26-056c-47ea-9763-8a02f745dc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.024787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf8d26-056c-47ea-9763-8a02f745dc98 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.035146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf8d26-056c-47ea-9763-8a02f745dc98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:18:10.041843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-bfcf8d26-056c-47ea-9763-8a02f745dc98 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 01:18:10.043067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 553/1131] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:18:10.050588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61d688-9a95-434e-9a17-acfd585eaa7b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.060456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61d688-9a95-434e-9a17-acfd585eaa7b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.065508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228213e-a739-4e7e-9a69-199d73bcd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.066312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228213e-a739-4e7e-9a69-199d73bcd692 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.066670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228213e-a739-4e7e-9a69-199d73bcd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.067066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228213e-a739-4e7e-9a69-199d73bcd692 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.067930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228213e-a739-4e7e-9a69-199d73bcd692 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:10.068339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228213e-a739-4e7e-9a69-199d73bcd692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.069967 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228213e-a739-4e7e-9a69-199d73bcd692 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.078317 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 579/1132] 10.222.0.23 () {56 vars in 1125 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:18:10.084529 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf8d26-056c-47ea-9763-8a02f745dc98 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.094633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf8d26-056c-47ea-9763-8a02f745dc98 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.099271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd725f5-dcd4-4171-8926-1db4c01c28d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.100038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd725f5-dcd4-4171-8926-1db4c01c28d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.100319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd725f5-dcd4-4171-8926-1db4c01c28d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.100607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd725f5-dcd4-4171-8926-1db4c01c28d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.113965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd725f5-dcd4-4171-8926-1db4c01c28d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.116125 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd725f5-dcd4-4171-8926-1db4c01c28d7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.135946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-4cd725f5-dcd4-4171-8926-1db4c01c28d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:10.138912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 554/1133] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:10.144634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228213e-a739-4e7e-9a69-199d73bcd692 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.157570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228213e-a739-4e7e-9a69-199d73bcd692 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.163757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864d0d0-97e0-4fed-a52d-48a2cca5ad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.164428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864d0d0-97e0-4fed-a52d-48a2cca5ad88 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.164700 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864d0d0-97e0-4fed-a52d-48a2cca5ad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.164978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864d0d0-97e0-4fed-a52d-48a2cca5ad88 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.165697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864d0d0-97e0-4fed-a52d-48a2cca5ad88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:10.166009 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864d0d0-97e0-4fed-a52d-48a2cca5ad88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.167629 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864d0d0-97e0-4fed-a52d-48a2cca5ad88 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.181142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 580/1134] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:10.188188 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd725f5-dcd4-4171-8926-1db4c01c28d7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.200241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd725f5-dcd4-4171-8926-1db4c01c28d7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.206813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73156c9-1af8-4c41-a56d-b4658cae0dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.207617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73156c9-1af8-4c41-a56d-b4658cae0dfb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.207898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73156c9-1af8-4c41-a56d-b4658cae0dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.208171 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73156c9-1af8-4c41-a56d-b4658cae0dfb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.217830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73156c9-1af8-4c41-a56d-b4658cae0dfb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.221252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73156c9-1af8-4c41-a56d-b4658cae0dfb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.238180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-e73156c9-1af8-4c41-a56d-b4658cae0dfb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 01:18:10.239785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 555/1135] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:18:10.246306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864d0d0-97e0-4fed-a52d-48a2cca5ad88 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.255915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864d0d0-97e0-4fed-a52d-48a2cca5ad88 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.260876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e454-50a9-4822-809b-d19c2ad4f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.261608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e454-50a9-4822-809b-d19c2ad4f6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.261976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e454-50a9-4822-809b-d19c2ad4f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.262533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e454-50a9-4822-809b-d19c2ad4f6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.263615 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e454-50a9-4822-809b-d19c2ad4f6d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:10.263962 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e454-50a9-4822-809b-d19c2ad4f6d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.266573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e454-50a9-4822-809b-d19c2ad4f6d0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.286746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 581/1136] 10.222.0.23 () {56 vars in 1165 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:18:10.293057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73156c9-1af8-4c41-a56d-b4658cae0dfb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.302792 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73156c9-1af8-4c41-a56d-b4658cae0dfb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.307453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f06eab-55bf-468b-af45-daed874d0d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.308114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06eab-55bf-468b-af45-daed874d0d1e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.308394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06eab-55bf-468b-af45-daed874d0d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.308673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06eab-55bf-468b-af45-daed874d0d1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.316512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f06eab-55bf-468b-af45-daed874d0d1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.318251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f06eab-55bf-468b-af45-daed874d0d1e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.327061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 556/1137] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:18:10.333788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e454-50a9-4822-809b-d19c2ad4f6d0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.343787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e454-50a9-4822-809b-d19c2ad4f6d0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.348466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55d572-68a1-4ed4-9b1e-9b04daad64dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.349267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55d572-68a1-4ed4-9b1e-9b04daad64dd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.349555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55d572-68a1-4ed4-9b1e-9b04daad64dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.349836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55d572-68a1-4ed4-9b1e-9b04daad64dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.360082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55d572-68a1-4ed4-9b1e-9b04daad64dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.362138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55d572-68a1-4ed4-9b1e-9b04daad64dd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.381026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-7c55d572-68a1-4ed4-9b1e-9b04daad64dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:10.382299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 582/1138] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:10.388922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f06eab-55bf-468b-af45-daed874d0d1e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.399693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f06eab-55bf-468b-af45-daed874d0d1e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.404521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4b1f7-3bf1-441b-8143-5e74debd2e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.405254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4b1f7-3bf1-441b-8143-5e74debd2e08 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.406236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4b1f7-3bf1-441b-8143-5e74debd2e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.406575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4b1f7-3bf1-441b-8143-5e74debd2e08 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.407396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4b1f7-3bf1-441b-8143-5e74debd2e08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:10.407702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4b1f7-3bf1-441b-8143-5e74debd2e08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.409271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4b1f7-3bf1-441b-8143-5e74debd2e08 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.421323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 557/1139] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:18:10.427340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55d572-68a1-4ed4-9b1e-9b04daad64dd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.437310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55d572-68a1-4ed4-9b1e-9b04daad64dd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.442042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd4305-0c41-40bc-99a8-3c81e58d40d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.442873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4305-0c41-40bc-99a8-3c81e58d40d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.443142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4305-0c41-40bc-99a8-3c81e58d40d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.443417 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4305-0c41-40bc-99a8-3c81e58d40d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.450556 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd4305-0c41-40bc-99a8-3c81e58d40d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.453234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd4305-0c41-40bc-99a8-3c81e58d40d6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.466086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-f1fd4305-0c41-40bc-99a8-3c81e58d40d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:18:10.467262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 583/1140] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:10.474151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4b1f7-3bf1-441b-8143-5e74debd2e08 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.483625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4b1f7-3bf1-441b-8143-5e74debd2e08 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.488299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8daba1-b1a9-41fc-bb01-158c4fc5743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.488960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8daba1-b1a9-41fc-bb01-158c4fc5743c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.489237 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8daba1-b1a9-41fc-bb01-158c4fc5743c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.489536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8daba1-b1a9-41fc-bb01-158c4fc5743c admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.490285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8daba1-b1a9-41fc-bb01-158c4fc5743c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:10.490591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8daba1-b1a9-41fc-bb01-158c4fc5743c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.492476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8daba1-b1a9-41fc-bb01-158c4fc5743c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.506268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 558/1141] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:10.513002 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd4305-0c41-40bc-99a8-3c81e58d40d6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:10.524829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd4305-0c41-40bc-99a8-3c81e58d40d6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:10.529953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c064c2-338a-46d9-bafb-576653f52218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:10.531209 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c064c2-338a-46d9-bafb-576653f52218 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:10.531616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c064c2-338a-46d9-bafb-576653f52218 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:10.531903 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c064c2-338a-46d9-bafb-576653f52218 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:10.532859 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c064c2-338a-46d9-bafb-576653f52218 admin admin] RBAC: Adding query filter params (role.id=a7290d45b88b4a14ab8a17f724c7adf9, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=40b49222a8e4474bbe14019418ec8aa6) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:10.533249 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c064c2-338a-46d9-bafb-576653f52218 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:10.535657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c064c2-338a-46d9-bafb-576653f52218 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:10.550740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 584/1142] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:18:10 2021] GET /identity/v3/role_assignments?user.id=40b49222a8e4474bbe14019418ec8aa6&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=a7290d45b88b4a14ab8a17f724c7adf9 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:12.734114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801c1f-7626-4817-b33f-0849e15da2dc None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:12.734739 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801c1f-7626-4817-b33f-0849e15da2dc None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:12.734739 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801c1f-7626-4817-b33f-0849e15da2dc None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:12.736571 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 559/1143] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:18:12.742401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532db51-78f4-4de5-a431-5cdbfd55f1e5 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:12.742824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532db51-78f4-4de5-a431-5cdbfd55f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:12.742993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532db51-78f4-4de5-a431-5cdbfd55f1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:12.761273 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e532db51-78f4-4de5-a431-5cdbfd55f1e5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:12.762654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e532db51-78f4-4de5-a431-5cdbfd55f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:12.770768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 585/1144] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:18:12.795592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4801c1f-7626-4817-b33f-0849e15da2dc None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:12.808388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4801c1f-7626-4817-b33f-0849e15da2dc None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:12.813579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1e5e8-452c-438c-929d-83eefe80f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:12.814345 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1e5e8-452c-438c-929d-83eefe80f56d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:12.814628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1e5e8-452c-438c-929d-83eefe80f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:12.814946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1e5e8-452c-438c-929d-83eefe80f56d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:12.825266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1e5e8-452c-438c-929d-83eefe80f56d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:18:12.832130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-66f1e5e8-452c-438c-929d-83eefe80f56d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:18:12.833287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 560/1145] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:18:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:12.839908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532db51-78f4-4de5-a431-5cdbfd55f1e5 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:12.850401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532db51-78f4-4de5-a431-5cdbfd55f1e5 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:12.855419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eea6e-a793-4b83-b7fd-046008db4aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:12.856080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eea6e-a793-4b83-b7fd-046008db4aef admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:12.856353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eea6e-a793-4b83-b7fd-046008db4aef admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:12.856627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eea6e-a793-4b83-b7fd-046008db4aef admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:12.857359 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eea6e-a793-4b83-b7fd-046008db4aef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:12.857661 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eea6e-a793-4b83-b7fd-046008db4aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:12.859849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eea6e-a793-4b83-b7fd-046008db4aef admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:12.869168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 586/1146] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:18:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:12.876284 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1e5e8-452c-438c-929d-83eefe80f56d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:12.888134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1e5e8-452c-438c-929d-83eefe80f56d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:12.893209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e92fa-97c6-484e-b13d-e945e1d56ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:12.893979 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e92fa-97c6-484e-b13d-e945e1d56ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:12.894264 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e92fa-97c6-484e-b13d-e945e1d56ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:12.894540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e92fa-97c6-484e-b13d-e945e1d56ad3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:12.905293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e92fa-97c6-484e-b13d-e945e1d56ad3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:12.907710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e92fa-97c6-484e-b13d-e945e1d56ad3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:12.926098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-ee2e92fa-97c6-484e-b13d-e945e1d56ad3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:12.927433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 561/1147] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 01:18:12.934992 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eea6e-a793-4b83-b7fd-046008db4aef admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:12.945005 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eea6e-a793-4b83-b7fd-046008db4aef admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:12.950334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9339fd9-864d-4174-9d34-21382e4fa435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:12.951140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339fd9-864d-4174-9d34-21382e4fa435 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:12.951418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339fd9-864d-4174-9d34-21382e4fa435 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:12.951699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339fd9-864d-4174-9d34-21382e4fa435 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:12.952554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339fd9-864d-4174-9d34-21382e4fa435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:12.952997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339fd9-864d-4174-9d34-21382e4fa435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:12.955002 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339fd9-864d-4174-9d34-21382e4fa435 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:12.974195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 587/1148] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:12.975654 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e92fa-97c6-484e-b13d-e945e1d56ad3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:12.986050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e92fa-97c6-484e-b13d-e945e1d56ad3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:12.990809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa289cc-7223-447a-9da7-554510c4f8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:12.991591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa289cc-7223-447a-9da7-554510c4f8cf admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:12.991876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa289cc-7223-447a-9da7-554510c4f8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:12.992148 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa289cc-7223-447a-9da7-554510c4f8cf admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:12.999790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa289cc-7223-447a-9da7-554510c4f8cf admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:13.001780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa289cc-7223-447a-9da7-554510c4f8cf admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:13.016898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-3fa289cc-7223-447a-9da7-554510c4f8cf admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 01:18:13.017992 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 562/1149] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:12 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:13.024829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9339fd9-864d-4174-9d34-21382e4fa435 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:13.037069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9339fd9-864d-4174-9d34-21382e4fa435 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:13.042395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd0f03-96be-4b80-b369-5bfd76242843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:13.043211 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd0f03-96be-4b80-b369-5bfd76242843 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:13.043556 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd0f03-96be-4b80-b369-5bfd76242843 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:13.043848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd0f03-96be-4b80-b369-5bfd76242843 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:13.044750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd0f03-96be-4b80-b369-5bfd76242843 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:13.045076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd0f03-96be-4b80-b369-5bfd76242843 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:13.047696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd0f03-96be-4b80-b369-5bfd76242843 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:13.066504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 588/1150] 10.222.0.23 () {56 vars in 1165 bytes} [Wed Aug 25 01:18:13 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:13.072995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa289cc-7223-447a-9da7-554510c4f8cf admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:13.083721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa289cc-7223-447a-9da7-554510c4f8cf admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:13.088248 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d957d2f-0386-4e48-9e8d-aef3364ee3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:13.088888 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d957d2f-0386-4e48-9e8d-aef3364ee3dc admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:13.089169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d957d2f-0386-4e48-9e8d-aef3364ee3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:13.089495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d957d2f-0386-4e48-9e8d-aef3364ee3dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:13.097872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d957d2f-0386-4e48-9e8d-aef3364ee3dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:13.099636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d957d2f-0386-4e48-9e8d-aef3364ee3dc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:13.108356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 563/1151] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:18:13 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:18:13.115675 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd0f03-96be-4b80-b369-5bfd76242843 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:13.125267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd0f03-96be-4b80-b369-5bfd76242843 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:13.129854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde18fbb-86c8-4dee-824f-e8934a01dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:13.130632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde18fbb-86c8-4dee-824f-e8934a01dc85 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:13.130954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde18fbb-86c8-4dee-824f-e8934a01dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:13.131210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde18fbb-86c8-4dee-824f-e8934a01dc85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:13.142165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde18fbb-86c8-4dee-824f-e8934a01dc85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:13.144019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde18fbb-86c8-4dee-824f-e8934a01dc85 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:13.162619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-fde18fbb-86c8-4dee-824f-e8934a01dc85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:13.163904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 589/1152] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:13.170692 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d957d2f-0386-4e48-9e8d-aef3364ee3dc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:13.180477 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d957d2f-0386-4e48-9e8d-aef3364ee3dc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:13.184996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340a329-12e1-42ca-9dac-87631be58331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:13.185641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340a329-12e1-42ca-9dac-87631be58331 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:13.185922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340a329-12e1-42ca-9dac-87631be58331 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:13.186195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340a329-12e1-42ca-9dac-87631be58331 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:13.186967 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340a329-12e1-42ca-9dac-87631be58331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:13.187268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340a329-12e1-42ca-9dac-87631be58331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:13.188843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340a329-12e1-42ca-9dac-87631be58331 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:13.200511 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 564/1153] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:13.207330 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde18fbb-86c8-4dee-824f-e8934a01dc85 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:13.216899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde18fbb-86c8-4dee-824f-e8934a01dc85 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:13.222822 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37ccbf-7134-4b25-a364-52fa9a4e4a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:13.223698 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37ccbf-7134-4b25-a364-52fa9a4e4a98 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:13.224026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37ccbf-7134-4b25-a364-52fa9a4e4a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:13.224362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37ccbf-7134-4b25-a364-52fa9a4e4a98 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:13.232007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37ccbf-7134-4b25-a364-52fa9a4e4a98 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:13.234288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37ccbf-7134-4b25-a364-52fa9a4e4a98 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:13.247583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-5e37ccbf-7134-4b25-a364-52fa9a4e4a98 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:18:13.248743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 590/1154] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:18:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:13.259448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340a329-12e1-42ca-9dac-87631be58331 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:13.270235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340a329-12e1-42ca-9dac-87631be58331 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:13.274964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33986595-0cd1-4ae5-a78a-6447e18da331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:13.275602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33986595-0cd1-4ae5-a78a-6447e18da331 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:13.275884 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33986595-0cd1-4ae5-a78a-6447e18da331 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:13.276162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33986595-0cd1-4ae5-a78a-6447e18da331 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:13.276934 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33986595-0cd1-4ae5-a78a-6447e18da331 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:13.277234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33986595-0cd1-4ae5-a78a-6447e18da331 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:13.279233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33986595-0cd1-4ae5-a78a-6447e18da331 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:13.292074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 565/1155] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:18:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:13.299500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37ccbf-7134-4b25-a364-52fa9a4e4a98 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:13.310540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37ccbf-7134-4b25-a364-52fa9a4e4a98 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:13.315228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d40327-3555-480b-a619-1bc89dd365a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:13.315861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d40327-3555-480b-a619-1bc89dd365a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:13.316145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d40327-3555-480b-a619-1bc89dd365a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:13.316420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d40327-3555-480b-a619-1bc89dd365a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:13.317245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d40327-3555-480b-a619-1bc89dd365a9 admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=40b49222a8e4474bbe14019418ec8aa6) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:13.317554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d40327-3555-480b-a619-1bc89dd365a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:13.319439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d40327-3555-480b-a619-1bc89dd365a9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:13.324956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 591/1156] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:18:13 2021] GET /identity/v3/role_assignments?user.id=40b49222a8e4474bbe14019418ec8aa6&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:15.429761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da2b41-befc-4fc7-9328-af9ca7f16d75 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.430349 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da2b41-befc-4fc7-9328-af9ca7f16d75 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.430349 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da2b41-befc-4fc7-9328-af9ca7f16d75 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.432076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 566/1157] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:18:15.438577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96ed7d-3bb8-4cf9-974f-21f083e62dd1 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.439082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96ed7d-3bb8-4cf9-974f-21f083e62dd1 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.439170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96ed7d-3bb8-4cf9-974f-21f083e62dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.456946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-1c96ed7d-3bb8-4cf9-974f-21f083e62dd1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:15.458126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1c96ed7d-3bb8-4cf9-974f-21f083e62dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:15.466059 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 592/1158] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:18:15.490021 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da2b41-befc-4fc7-9328-af9ca7f16d75 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.503158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da2b41-befc-4fc7-9328-af9ca7f16d75 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.509499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f551-8bab-4f80-98a0-3892738b6696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.510278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f551-8bab-4f80-98a0-3892738b6696 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.510560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f551-8bab-4f80-98a0-3892738b6696 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.510871 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f551-8bab-4f80-98a0-3892738b6696 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.521614 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92f551-8bab-4f80-98a0-3892738b6696 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:18:15.528378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-cb92f551-8bab-4f80-98a0-3892738b6696 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:18:15.529493 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 567/1159] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:18:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:15.536488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96ed7d-3bb8-4cf9-974f-21f083e62dd1 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.545668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96ed7d-3bb8-4cf9-974f-21f083e62dd1 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.550854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0fa8-ff7f-4ae4-97e7-107d7e98ec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.551513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0fa8-ff7f-4ae4-97e7-107d7e98ec79 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.551806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0fa8-ff7f-4ae4-97e7-107d7e98ec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.552075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0fa8-ff7f-4ae4-97e7-107d7e98ec79 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.552808 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0fa8-ff7f-4ae4-97e7-107d7e98ec79 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:15.553111 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0fa8-ff7f-4ae4-97e7-107d7e98ec79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:15.554710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0fa8-ff7f-4ae4-97e7-107d7e98ec79 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:15.563715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 593/1160] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:18:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:18:15.571454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f551-8bab-4f80-98a0-3892738b6696 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.581704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f551-8bab-4f80-98a0-3892738b6696 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.586498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c7e35-8615-4fe8-b256-f499df89b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.587300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7e35-8615-4fe8-b256-f499df89b178 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.587580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7e35-8615-4fe8-b256-f499df89b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.587855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c7e35-8615-4fe8-b256-f499df89b178 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.598040 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c7e35-8615-4fe8-b256-f499df89b178 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:15.599885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c7e35-8615-4fe8-b256-f499df89b178 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:15.617032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-554c7e35-8615-4fe8-b256-f499df89b178 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:15.618204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 568/1161] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:15.625297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0fa8-ff7f-4ae4-97e7-107d7e98ec79 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.636177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0fa8-ff7f-4ae4-97e7-107d7e98ec79 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.641462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffac5d8-1843-42fd-8bb2-cc80ab1996ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.642121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffac5d8-1843-42fd-8bb2-cc80ab1996ba admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.642407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffac5d8-1843-42fd-8bb2-cc80ab1996ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.642701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffac5d8-1843-42fd-8bb2-cc80ab1996ba admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.643422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffac5d8-1843-42fd-8bb2-cc80ab1996ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:15.643734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffac5d8-1843-42fd-8bb2-cc80ab1996ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:15.645317 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffac5d8-1843-42fd-8bb2-cc80ab1996ba admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:15.657591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 594/1162] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:15.664081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c7e35-8615-4fe8-b256-f499df89b178 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.674635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c7e35-8615-4fe8-b256-f499df89b178 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.679703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fe27a-e88c-414f-ad89-0de042d2adb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.680594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fe27a-e88c-414f-ad89-0de042d2adb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.680833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fe27a-e88c-414f-ad89-0de042d2adb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.681107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fe27a-e88c-414f-ad89-0de042d2adb2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.689427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fe27a-e88c-414f-ad89-0de042d2adb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:15.691700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fe27a-e88c-414f-ad89-0de042d2adb2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:15.706218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-7a1fe27a-e88c-414f-ad89-0de042d2adb2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 01:18:15.707410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 569/1163] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:15 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:15.713874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffac5d8-1843-42fd-8bb2-cc80ab1996ba admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.724046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffac5d8-1843-42fd-8bb2-cc80ab1996ba admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.729294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95c32-e613-45c2-8d35-09da637e4680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.729963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95c32-e613-45c2-8d35-09da637e4680 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.730244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95c32-e613-45c2-8d35-09da637e4680 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.730520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95c32-e613-45c2-8d35-09da637e4680 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.731394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95c32-e613-45c2-8d35-09da637e4680 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:15.731699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95c32-e613-45c2-8d35-09da637e4680 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:15.734068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95c32-e613-45c2-8d35-09da637e4680 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:15.753394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 595/1164] 10.222.0.23 () {56 vars in 1165 bytes} [Wed Aug 25 01:18:15 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:18:15.759908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fe27a-e88c-414f-ad89-0de042d2adb2 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.771982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fe27a-e88c-414f-ad89-0de042d2adb2 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.776528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f8a92-6e99-443c-99e6-187a8a6a013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.777309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f8a92-6e99-443c-99e6-187a8a6a013d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.777591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f8a92-6e99-443c-99e6-187a8a6a013d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.777864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f8a92-6e99-443c-99e6-187a8a6a013d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.790107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f8a92-6e99-443c-99e6-187a8a6a013d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:15.792266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f8a92-6e99-443c-99e6-187a8a6a013d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:15.812970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-3b5f8a92-6e99-443c-99e6-187a8a6a013d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:15.814319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 570/1165] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:15.823141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95c32-e613-45c2-8d35-09da637e4680 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.835022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95c32-e613-45c2-8d35-09da637e4680 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.840661 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1b1a-f397-478d-b105-88885366194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.841471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1b1a-f397-478d-b105-88885366194a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.841765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1b1a-f397-478d-b105-88885366194a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.842259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1b1a-f397-478d-b105-88885366194a admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.843633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c1b1a-f397-478d-b105-88885366194a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:15.844229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c1b1a-f397-478d-b105-88885366194a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:15.846132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c1b1a-f397-478d-b105-88885366194a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:15.859733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 596/1166] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:15.866239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f8a92-6e99-443c-99e6-187a8a6a013d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.876746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f8a92-6e99-443c-99e6-187a8a6a013d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.882033 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad84e0-0af8-417c-9b92-ed025423ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.883095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad84e0-0af8-417c-9b92-ed025423ee12 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.883542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad84e0-0af8-417c-9b92-ed025423ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.883880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad84e0-0af8-417c-9b92-ed025423ee12 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.891745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad84e0-0af8-417c-9b92-ed025423ee12 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:15.893721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad84e0-0af8-417c-9b92-ed025423ee12 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:15.907808 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-4dad84e0-0af8-417c-9b92-ed025423ee12 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:18:15.909377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 571/1167] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:18:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:15.917051 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1b1a-f397-478d-b105-88885366194a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.927586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1b1a-f397-478d-b105-88885366194a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.932420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b1403-cb3f-4ed5-b57b-94da0c7fcd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.932998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b1403-cb3f-4ed5-b57b-94da0c7fcd87 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.933259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b1403-cb3f-4ed5-b57b-94da0c7fcd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.933532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b1403-cb3f-4ed5-b57b-94da0c7fcd87 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.934307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b1403-cb3f-4ed5-b57b-94da0c7fcd87 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:15.934611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b1403-cb3f-4ed5-b57b-94da0c7fcd87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:15.936489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b1403-cb3f-4ed5-b57b-94da0c7fcd87 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:15.949978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 597/1168] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:18:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:18:15.957235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad84e0-0af8-417c-9b92-ed025423ee12 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:15.969158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad84e0-0af8-417c-9b92-ed025423ee12 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:15.973890 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730afefa-b21d-488a-866a-fe9e67615ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:15.974794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730afefa-b21d-488a-866a-fe9e67615ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:15.975077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730afefa-b21d-488a-866a-fe9e67615ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:15.975353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730afefa-b21d-488a-866a-fe9e67615ce4 admin admin] PATH_INFO: `/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/40b49222a8e4474bbe14019418ec8aa6/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:15.977310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730afefa-b21d-488a-866a-fe9e67615ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c05a7beb6b04d15994db7ac0c7b98a2, user_id=40b49222a8e4474bbe14019418ec8aa6, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:15.979971 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730afefa-b21d-488a-866a-fe9e67615ce4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:15.993685 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 572/1169] 10.222.0.23 () {58 vars in 1461 bytes} [Wed Aug 25 01:18:15 2021] PUT /identity/v3/projects/7c05a7beb6b04d15994db7ac0c7b98a2/users/40b49222a8e4474bbe14019418ec8aa6/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:18:18.300349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3e66-c2b4-4714-98bd-10e30bb2d3b4 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.300877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3e66-c2b4-4714-98bd-10e30bb2d3b4 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.300877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3e66-c2b4-4714-98bd-10e30bb2d3b4 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.302663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 598/1170] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:18:18.308277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f812cb-19bc-4f61-80c6-ec5b87cb7993 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.308692 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f812cb-19bc-4f61-80c6-ec5b87cb7993 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.308819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f812cb-19bc-4f61-80c6-ec5b87cb7993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.325341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-27f812cb-19bc-4f61-80c6-ec5b87cb7993 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:18.326504 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-27f812cb-19bc-4f61-80c6-ec5b87cb7993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:18.379855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 573/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:18:18.403826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c3e66-c2b4-4714-98bd-10e30bb2d3b4 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.416147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c3e66-c2b4-4714-98bd-10e30bb2d3b4 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.420597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1672f1-ba4e-4296-a096-9c05848c7644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.421922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1672f1-ba4e-4296-a096-9c05848c7644 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.422204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1672f1-ba4e-4296-a096-9c05848c7644 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.422476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1672f1-ba4e-4296-a096-9c05848c7644 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.432370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1672f1-ba4e-4296-a096-9c05848c7644 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 01:18:18.439123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-0c1672f1-ba4e-4296-a096-9c05848c7644 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 01:18:18.440238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 599/1172] 10.222.0.23 () {56 vars in 1118 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:18.446223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f812cb-19bc-4f61-80c6-ec5b87cb7993 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.455168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f812cb-19bc-4f61-80c6-ec5b87cb7993 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.459494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d220f-95a1-4aa3-856b-72119f4ad403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.460127 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d220f-95a1-4aa3-856b-72119f4ad403 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.460406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d220f-95a1-4aa3-856b-72119f4ad403 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.460680 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d220f-95a1-4aa3-856b-72119f4ad403 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.465572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d220f-95a1-4aa3-856b-72119f4ad403 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:18.465896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d220f-95a1-4aa3-856b-72119f4ad403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.467510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d220f-95a1-4aa3-856b-72119f4ad403 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.475960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 574/1173] 10.222.0.23 () {56 vars in 1121 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:18.481698 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1672f1-ba4e-4296-a096-9c05848c7644 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.491662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1672f1-ba4e-4296-a096-9c05848c7644 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.496114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85223a5f-9f8c-4c75-af71-fca905db2215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.496904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85223a5f-9f8c-4c75-af71-fca905db2215 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.497185 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85223a5f-9f8c-4c75-af71-fca905db2215 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.497456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85223a5f-9f8c-4c75-af71-fca905db2215 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.507586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85223a5f-9f8c-4c75-af71-fca905db2215 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.509408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85223a5f-9f8c-4c75-af71-fca905db2215 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.526404 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-85223a5f-9f8c-4c75-af71-fca905db2215 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:18.527582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 600/1174] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:18.534233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d220f-95a1-4aa3-856b-72119f4ad403 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.543546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d220f-95a1-4aa3-856b-72119f4ad403 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.551897 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a33db-44c2-415f-86e4-00d6fcec4e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.552494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a33db-44c2-415f-86e4-00d6fcec4e64 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.552779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a33db-44c2-415f-86e4-00d6fcec4e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.553057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a33db-44c2-415f-86e4-00d6fcec4e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.553770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a33db-44c2-415f-86e4-00d6fcec4e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:18.554083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a33db-44c2-415f-86e4-00d6fcec4e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.555691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a33db-44c2-415f-86e4-00d6fcec4e64 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.566983 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 575/1175] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:18.572682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85223a5f-9f8c-4c75-af71-fca905db2215 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.582360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85223a5f-9f8c-4c75-af71-fca905db2215 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.586802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc0cdc-10de-4f71-bacb-b578cb792b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.587560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc0cdc-10de-4f71-bacb-b578cb792b29 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.587839 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc0cdc-10de-4f71-bacb-b578cb792b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.588112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc0cdc-10de-4f71-bacb-b578cb792b29 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.595755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc0cdc-10de-4f71-bacb-b578cb792b29 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.597735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc0cdc-10de-4f71-bacb-b578cb792b29 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.611202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-79cc0cdc-10de-4f71-bacb-b578cb792b29 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 01:18:18.612286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 601/1176] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:18.618139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a33db-44c2-415f-86e4-00d6fcec4e64 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.627315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a33db-44c2-415f-86e4-00d6fcec4e64 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.631719 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09988c30-38de-4c19-8efb-fe95e4aec63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.632352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09988c30-38de-4c19-8efb-fe95e4aec63e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.632634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09988c30-38de-4c19-8efb-fe95e4aec63e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.632910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09988c30-38de-4c19-8efb-fe95e4aec63e admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.633723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09988c30-38de-4c19-8efb-fe95e4aec63e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:18.634029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09988c30-38de-4c19-8efb-fe95e4aec63e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.635849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09988c30-38de-4c19-8efb-fe95e4aec63e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.652788 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 576/1177] 10.222.0.23 () {56 vars in 1165 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:18.659144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc0cdc-10de-4f71-bacb-b578cb792b29 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.668342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc0cdc-10de-4f71-bacb-b578cb792b29 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.672822 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8874dc-eb4b-446f-aabc-0d7202c496fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.673439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8874dc-eb4b-446f-aabc-0d7202c496fe admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.673725 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8874dc-eb4b-446f-aabc-0d7202c496fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.674003 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8874dc-eb4b-446f-aabc-0d7202c496fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.681559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8874dc-eb4b-446f-aabc-0d7202c496fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.683306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8874dc-eb4b-446f-aabc-0d7202c496fe admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.691875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 602/1178] 10.222.0.23 () {58 vars in 1325 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:18:18.697631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09988c30-38de-4c19-8efb-fe95e4aec63e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.707183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09988c30-38de-4c19-8efb-fe95e4aec63e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.711554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53783ff7-0c47-47c1-93fb-c4e9a354b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.712299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53783ff7-0c47-47c1-93fb-c4e9a354b4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.712579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53783ff7-0c47-47c1-93fb-c4e9a354b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.712852 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53783ff7-0c47-47c1-93fb-c4e9a354b4f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.723143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53783ff7-0c47-47c1-93fb-c4e9a354b4f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.724903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53783ff7-0c47-47c1-93fb-c4e9a354b4f4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.740570 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-53783ff7-0c47-47c1-93fb-c4e9a354b4f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 01:18:18.741649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 577/1179] 10.222.0.23 () {56 vars in 1130 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:18.747247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8874dc-eb4b-446f-aabc-0d7202c496fe admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.755588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8874dc-eb4b-446f-aabc-0d7202c496fe admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.760217 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9425c-4608-492b-85e6-8a6f6057e0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.760718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9425c-4608-492b-85e6-8a6f6057e0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.761022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9425c-4608-492b-85e6-8a6f6057e0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.761324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9425c-4608-492b-85e6-8a6f6057e0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.762367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9425c-4608-492b-85e6-8a6f6057e0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:18.762804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9425c-4608-492b-85e6-8a6f6057e0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.765071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9425c-4608-492b-85e6-8a6f6057e0c2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.777724 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 603/1180] 10.222.0.23 () {56 vars in 1131 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:18.784472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53783ff7-0c47-47c1-93fb-c4e9a354b4f4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.795368 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53783ff7-0c47-47c1-93fb-c4e9a354b4f4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.800743 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab2a34-5134-40ee-ba2e-6060b838ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.801575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab2a34-5134-40ee-ba2e-6060b838ae6d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.801953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab2a34-5134-40ee-ba2e-6060b838ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.802216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab2a34-5134-40ee-ba2e-6060b838ae6d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.810482 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab2a34-5134-40ee-ba2e-6060b838ae6d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.813317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab2a34-5134-40ee-ba2e-6060b838ae6d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.830472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING keystone.server.flask.application [None req-5fab2a34-5134-40ee-ba2e-6060b838ae6d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 01:18:18.831784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 578/1181] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:18.838836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9425c-4608-492b-85e6-8a6f6057e0c2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.849659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9425c-4608-492b-85e6-8a6f6057e0c2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.855262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d3e30-8323-4fb0-8ca6-80a95c06ff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.855910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d3e30-8323-4fb0-8ca6-80a95c06ff74 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.856193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d3e30-8323-4fb0-8ca6-80a95c06ff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.856468 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d3e30-8323-4fb0-8ca6-80a95c06ff74 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.857238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d3e30-8323-4fb0-8ca6-80a95c06ff74 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:18.857543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d3e30-8323-4fb0-8ca6-80a95c06ff74 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.859396 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d3e30-8323-4fb0-8ca6-80a95c06ff74 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.871183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 604/1182] 10.222.0.23 () {56 vars in 1170 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:18.877851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab2a34-5134-40ee-ba2e-6060b838ae6d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:18.888454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab2a34-5134-40ee-ba2e-6060b838ae6d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:18.893481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ac15b-3492-4f73-af92-655ad3bc1112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:18.894100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ac15b-3492-4f73-af92-655ad3bc1112 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:18.894383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ac15b-3492-4f73-af92-655ad3bc1112 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:18.894658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ac15b-3492-4f73-af92-655ad3bc1112 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:18.895494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ac15b-3492-4f73-af92-655ad3bc1112 admin admin] RBAC: Adding query filter params (role.id=2bd7b644c431434aad6e3453e58eb3af, scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2, user.id=40b49222a8e4474bbe14019418ec8aa6) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:18.895800 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ac15b-3492-4f73-af92-655ad3bc1112 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:18.897590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ac15b-3492-4f73-af92-655ad3bc1112 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:18.903144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 579/1183] 10.222.0.23 () {56 vars in 1396 bytes} [Wed Aug 25 01:18:18 2021] GET /identity/v3/role_assignments?user.id=40b49222a8e4474bbe14019418ec8aa6&scope.project.id=7c05a7beb6b04d15994db7ac0c7b98a2&role.id=2bd7b644c431434aad6e3453e58eb3af => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:21.023550 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dfa48-6ce1-4804-bde5-80f7a18f7bc4 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:21.024088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dfa48-6ce1-4804-bde5-80f7a18f7bc4 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:21.024088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dfa48-6ce1-4804-bde5-80f7a18f7bc4 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:21.025908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 605/1184] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:18:21.032184 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ac5cd-25b6-4f0c-8ef6-3c2ffd69e813 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:21.032585 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ac5cd-25b6-4f0c-8ef6-3c2ffd69e813 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:21.032729 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ac5cd-25b6-4f0c-8ef6-3c2ffd69e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:21.049254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-495ac5cd-25b6-4f0c-8ef6-3c2ffd69e813 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:21.050417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-495ac5cd-25b6-4f0c-8ef6-3c2ffd69e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:21.057811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 580/1185] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:18:21.082093 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dfa48-6ce1-4804-bde5-80f7a18f7bc4 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:21.094206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dfa48-6ce1-4804-bde5-80f7a18f7bc4 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:21.098519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb57c-bd27-42ec-8e75-ad842b2c92e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:21.099344 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb57c-bd27-42ec-8e75-ad842b2c92e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:21.099627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb57c-bd27-42ec-8e75-ad842b2c92e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:21.099903 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb57c-bd27-42ec-8e75-ad842b2c92e1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:21.100547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb57c-bd27-42ec-8e75-ad842b2c92e1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:21.102132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb57c-bd27-42ec-8e75-ad842b2c92e1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:21.112880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-6f8eb57c-bd27-42ec-8e75-ad842b2c92e1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 01:18:21.114001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 606/1186] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 25 01:18:21 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:21.120534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ac5cd-25b6-4f0c-8ef6-3c2ffd69e813 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:21.129946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ac5cd-25b6-4f0c-8ef6-3c2ffd69e813 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:21.134417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebdd18-9923-4422-ae15-016a760604cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:21.135101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebdd18-9923-4422-ae15-016a760604cc admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:21.135383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebdd18-9923-4422-ae15-016a760604cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:21.135656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebdd18-9923-4422-ae15-016a760604cc admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:21.136353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebdd18-9923-4422-ae15-016a760604cc admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:21.136655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebdd18-9923-4422-ae15-016a760604cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:21.138478 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebdd18-9923-4422-ae15-016a760604cc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:21.143761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 581/1187] 10.222.0.23 () {56 vars in 1138 bytes} [Wed Aug 25 01:18:21 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:21.149499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb57c-bd27-42ec-8e75-ad842b2c92e1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:21.158735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb57c-bd27-42ec-8e75-ad842b2c92e1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:21.163090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb400bd-f3c7-4dde-bba0-409836593e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:21.163710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb400bd-f3c7-4dde-bba0-409836593e5c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:21.163990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb400bd-f3c7-4dde-bba0-409836593e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:21.164262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb400bd-f3c7-4dde-bba0-409836593e5c admin admin] PATH_INFO: `/v3/services` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:21.164939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb400bd-f3c7-4dde-bba0-409836593e5c admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:21.165239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb400bd-f3c7-4dde-bba0-409836593e5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:21.166795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb400bd-f3c7-4dde-bba0-409836593e5c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:21.170972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 607/1188] 10.222.0.23 () {56 vars in 1138 bytes} [Wed Aug 25 01:18:21 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:23.303595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709526-5744-4621-9c58-889bb90c89eb None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:23.304126 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709526-5744-4621-9c58-889bb90c89eb None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:23.304126 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709526-5744-4621-9c58-889bb90c89eb None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:23.305896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 582/1189] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:18:23.312376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a3235-4bfa-4f85-a8f6-637e95a648f8 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:23.312758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a3235-4bfa-4f85-a8f6-637e95a648f8 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:23.312922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a3235-4bfa-4f85-a8f6-637e95a648f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:23.330971 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-469a3235-4bfa-4f85-a8f6-637e95a648f8 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:23.332142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-469a3235-4bfa-4f85-a8f6-637e95a648f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:23.339566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 608/1190] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:18:23.363381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709526-5744-4621-9c58-889bb90c89eb None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:23.375158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709526-5744-4621-9c58-889bb90c89eb None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:23.379457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7889b2-4684-42c2-9c0d-47ad9d749cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:23.380086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7889b2-4684-42c2-9c0d-47ad9d749cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:23.380370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7889b2-4684-42c2-9c0d-47ad9d749cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:23.380647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7889b2-4684-42c2-9c0d-47ad9d749cb6 admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:23.381366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7889b2-4684-42c2-9c0d-47ad9d749cb6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:23.383053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7889b2-4684-42c2-9c0d-47ad9d749cb6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:23.395620 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 583/1191] 10.222.0.23 () {60 vars in 1163 bytes} [Wed Aug 25 01:18:23 2021] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:18:25.523346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3c267-31b3-4c2b-9ea6-d49103c4a1ab None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:25.523787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3c267-31b3-4c2b-9ea6-d49103c4a1ab None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:25.523906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3c267-31b3-4c2b-9ea6-d49103c4a1ab None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:25.525660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 609/1192] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:18:25.532027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d0c6c-c1a6-4f41-91e9-0e677c695b9f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:25.532425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d0c6c-c1a6-4f41-91e9-0e677c695b9f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:25.532590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d0c6c-c1a6-4f41-91e9-0e677c695b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:25.549667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-353d0c6c-c1a6-4f41-91e9-0e677c695b9f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:25.550876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-353d0c6c-c1a6-4f41-91e9-0e677c695b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:25.567534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 584/1193] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:18:25.591343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3c267-31b3-4c2b-9ea6-d49103c4a1ab None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:25.603179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3c267-31b3-4c2b-9ea6-d49103c4a1ab None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:25.607548 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817291b0-4c85-4d10-beb7-71cd144d7a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:25.608312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817291b0-4c85-4d10-beb7-71cd144d7a8e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:25.608594 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817291b0-4c85-4d10-beb7-71cd144d7a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:25.608865 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817291b0-4c85-4d10-beb7-71cd144d7a8e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:25.609505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817291b0-4c85-4d10-beb7-71cd144d7a8e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:25.611112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817291b0-4c85-4d10-beb7-71cd144d7a8e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:25.621645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-817291b0-4c85-4d10-beb7-71cd144d7a8e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 01:18:25.622756 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 610/1194] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 25 01:18:25 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:25.629320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d0c6c-c1a6-4f41-91e9-0e677c695b9f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:25.638098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d0c6c-c1a6-4f41-91e9-0e677c695b9f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:25.643243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79539f9e-d2f8-4d2e-97da-666f08df7f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:25.643879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79539f9e-d2f8-4d2e-97da-666f08df7f1e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:25.644161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79539f9e-d2f8-4d2e-97da-666f08df7f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:25.644437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79539f9e-d2f8-4d2e-97da-666f08df7f1e admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:25.645134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79539f9e-d2f8-4d2e-97da-666f08df7f1e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:25.645439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79539f9e-d2f8-4d2e-97da-666f08df7f1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:25.647032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79539f9e-d2f8-4d2e-97da-666f08df7f1e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:25.651928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 585/1195] 10.222.0.23 () {56 vars in 1138 bytes} [Wed Aug 25 01:18:25 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:25.657673 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817291b0-4c85-4d10-beb7-71cd144d7a8e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:25.666779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817291b0-4c85-4d10-beb7-71cd144d7a8e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:25.671191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4626e3-e6bc-41e4-8ea5-08e7bfa999e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:25.671793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4626e3-e6bc-41e4-8ea5-08e7bfa999e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:25.672072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4626e3-e6bc-41e4-8ea5-08e7bfa999e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:25.672346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4626e3-e6bc-41e4-8ea5-08e7bfa999e2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:25.673105 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4626e3-e6bc-41e4-8ea5-08e7bfa999e2 admin admin] RBAC: Adding query filter params (interface=public, service_id=0cb0bddab9b54290b8472a43de4252cc, region_id=RegionOne) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:25.673413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4626e3-e6bc-41e4-8ea5-08e7bfa999e2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:25.674965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4626e3-e6bc-41e4-8ea5-08e7bfa999e2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:25.679730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 611/1196] 10.222.0.23 () {56 vars in 1273 bytes} [Wed Aug 25 01:18:25 2021] GET /identity/v3/endpoints?service_id=0cb0bddab9b54290b8472a43de4252cc&interface=public®ion_id=RegionOne => generated 194 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:25.685369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79539f9e-d2f8-4d2e-97da-666f08df7f1e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:25.694805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79539f9e-d2f8-4d2e-97da-666f08df7f1e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:25.699196 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fd708-a956-41ab-a7da-d99a1585058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:25.699799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fd708-a956-41ab-a7da-d99a1585058c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:25.700082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fd708-a956-41ab-a7da-d99a1585058c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:25.700359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fd708-a956-41ab-a7da-d99a1585058c admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:25.701008 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fd708-a956-41ab-a7da-d99a1585058c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:25.703176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fd708-a956-41ab-a7da-d99a1585058c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:25.709767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 586/1197] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:18:25 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:18:27.839182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a372529-3fe5-4f7a-9378-e453f8058d5e None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:27.839719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a372529-3fe5-4f7a-9378-e453f8058d5e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:27.839719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a372529-3fe5-4f7a-9378-e453f8058d5e None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:27.841812 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 612/1198] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:18:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:18:27.848403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658ad93-5a58-43cd-aae6-93eafb8b9682 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:27.848851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658ad93-5a58-43cd-aae6-93eafb8b9682 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:27.849029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658ad93-5a58-43cd-aae6-93eafb8b9682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:27.868703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a658ad93-5a58-43cd-aae6-93eafb8b9682 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:18:27.870063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a658ad93-5a58-43cd-aae6-93eafb8b9682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:18:27.878370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 587/1199] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:18:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:18:27.902313 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a372529-3fe5-4f7a-9378-e453f8058d5e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:27.914158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a372529-3fe5-4f7a-9378-e453f8058d5e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:27.918403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb0b75-aa5d-4e3f-84d9-9b76535c233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:27.919221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb0b75-aa5d-4e3f-84d9-9b76535c233d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:27.919502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb0b75-aa5d-4e3f-84d9-9b76535c233d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:27.919773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb0b75-aa5d-4e3f-84d9-9b76535c233d admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:27.920430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb0b75-aa5d-4e3f-84d9-9b76535c233d admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:27.921976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb0b75-aa5d-4e3f-84d9-9b76535c233d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:27.932539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING keystone.server.flask.application [None req-cfdb0b75-aa5d-4e3f-84d9-9b76535c233d admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 01:18:27.933624 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 613/1200] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Aug 25 01:18:27 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 01:18:27.940217 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658ad93-5a58-43cd-aae6-93eafb8b9682 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:27.948818 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658ad93-5a58-43cd-aae6-93eafb8b9682 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:27.953957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb001-8f84-4f8e-9456-45f52380c58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:27.954590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb001-8f84-4f8e-9456-45f52380c58c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:27.954908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb001-8f84-4f8e-9456-45f52380c58c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:27.955185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb001-8f84-4f8e-9456-45f52380c58c admin admin] PATH_INFO: `/v3/services` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:27.955879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb001-8f84-4f8e-9456-45f52380c58c admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:18:27.956184 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb001-8f84-4f8e-9456-45f52380c58c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:27.957740 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb001-8f84-4f8e-9456-45f52380c58c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:27.962627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 588/1201] 10.222.0.23 () {56 vars in 1138 bytes} [Wed Aug 25 01:18:27 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:18:27.968437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb0b75-aa5d-4e3f-84d9-9b76535c233d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:18:27.977480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb0b75-aa5d-4e3f-84d9-9b76535c233d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:18:27.981852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6072d11-11de-4256-8d7a-c0c2214d3745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:18:27.982462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6072d11-11de-4256-8d7a-c0c2214d3745 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:18:27.982783 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6072d11-11de-4256-8d7a-c0c2214d3745 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:18:27.983063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6072d11-11de-4256-8d7a-c0c2214d3745 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:18:27.983773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6072d11-11de-4256-8d7a-c0c2214d3745 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:18:27.985293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6072d11-11de-4256-8d7a-c0c2214d3745 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:18:28.003478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 614/1202] 10.222.0.23 () {60 vars in 1166 bytes} [Wed Aug 25 01:18:27 2021] POST /identity/v3/endpoints => generated 331 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:19:30.610255 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d71b4b-cfd6-405d-9605-548e270b3dd5 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:30.610909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d71b4b-cfd6-405d-9605-548e270b3dd5 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:30.610909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d71b4b-cfd6-405d-9605-548e270b3dd5 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:30.613423 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 589/1203] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:19:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:30.618953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34ed34-11c0-4cc8-9a9b-090116624689 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:30.619366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34ed34-11c0-4cc8-9a9b-090116624689 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:30.619600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34ed34-11c0-4cc8-9a9b-090116624689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:30.725747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-da34ed34-11c0-4cc8-9a9b-090116624689 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:30.727488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-da34ed34-11c0-4cc8-9a9b-090116624689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:30.863040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 615/1204] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:19:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:19:30.885414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d71b4b-cfd6-405d-9605-548e270b3dd5 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:30.887955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f6d71b4b-cfd6-405d-9605-548e270b3dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:31.015680 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d71b4b-cfd6-405d-9605-548e270b3dd5 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:31.110087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a390fa2-86d8-475d-9a73-d7e1dcb71449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:31.110778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a390fa2-86d8-475d-9a73-d7e1dcb71449 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:31.111064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a390fa2-86d8-475d-9a73-d7e1dcb71449 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:31.111340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a390fa2-86d8-475d-9a73-d7e1dcb71449 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:31.112064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a390fa2-86d8-475d-9a73-d7e1dcb71449 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:31.113906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a390fa2-86d8-475d-9a73-d7e1dcb71449 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:31.133718 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 590/1205] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:19:30 2021] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:19:33.368436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fdbb3-85b9-4a8d-b60a-8b5f83429f90 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:33.368986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fdbb3-85b9-4a8d-b60a-8b5f83429f90 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:33.368986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fdbb3-85b9-4a8d-b60a-8b5f83429f90 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:33.370804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 616/1206] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:19:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:33.376774 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01c00-51cc-4dae-9fb9-88d9d0d79374 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:33.377204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01c00-51cc-4dae-9fb9-88d9d0d79374 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:33.377330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01c00-51cc-4dae-9fb9-88d9d0d79374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:33.454076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-78f01c00-51cc-4dae-9fb9-88d9d0d79374 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:33.455300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-78f01c00-51cc-4dae-9fb9-88d9d0d79374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:33.551524 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 591/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:19:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:19:33.605129 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71280d17-ee9b-45cc-bf70-c4ab3f42d761 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:33.605417 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71280d17-ee9b-45cc-bf70-c4ab3f42d761 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:33.605743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71280d17-ee9b-45cc-bf70-c4ab3f42d761 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:33.607535 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 617/1208] 10.222.0.23 () {54 vars in 964 bytes} [Wed Aug 25 01:19:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:33.613855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f70903-792b-4f79-892f-50ace892894f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:33.614151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f70903-792b-4f79-892f-50ace892894f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:33.614436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f70903-792b-4f79-892f-50ace892894f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:33.685651 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a3f70903-792b-4f79-892f-50ace892894f None None] MFA Rules not processed for user `a08ace1a65c040bf97108a1660f962ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:33.686881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a3f70903-792b-4f79-892f-50ace892894f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:33.757816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 592/1209] 10.222.0.23 () {58 vars in 1062 bytes} [Wed Aug 25 01:19:33 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:19:33.767913 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71280d17-ee9b-45cc-bf70-c4ab3f42d761 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:33.769420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-71280d17-ee9b-45cc-bf70-c4ab3f42d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:33.868538 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71280d17-ee9b-45cc-bf70-c4ab3f42d761 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:33.938665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c446d15-e645-4f62-98e3-6cbcbf4bc271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:33.939327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446d15-e645-4f62-98e3-6cbcbf4bc271 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:33.939613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446d15-e645-4f62-98e3-6cbcbf4bc271 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:33.939887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446d15-e645-4f62-98e3-6cbcbf4bc271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:33.941505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6c446d15-e645-4f62-98e3-6cbcbf4bc271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:34.044587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c446d15-e645-4f62-98e3-6cbcbf4bc271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:34.045952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c446d15-e645-4f62-98e3-6cbcbf4bc271 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:34.063416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 618/1210] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:19:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:19:36.437137 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eed3e-be43-4e5f-bcdd-9163ec1684cb None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:36.437646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eed3e-be43-4e5f-bcdd-9163ec1684cb None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:36.437646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eed3e-be43-4e5f-bcdd-9163ec1684cb None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:36.439399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 593/1211] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:19:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:36.445286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564dcd7-9396-4250-a98b-2f5dcc53630b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:36.445718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564dcd7-9396-4250-a98b-2f5dcc53630b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:36.445836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564dcd7-9396-4250-a98b-2f5dcc53630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:36.508955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7564dcd7-9396-4250-a98b-2f5dcc53630b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:36.510157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7564dcd7-9396-4250-a98b-2f5dcc53630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:36.601578 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 619/1212] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:19:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:19:36.640649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eed3e-be43-4e5f-bcdd-9163ec1684cb None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:36.642179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8c0eed3e-be43-4e5f-bcdd-9163ec1684cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:36.741652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eed3e-be43-4e5f-bcdd-9163ec1684cb None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:36.811231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ffaf4-d535-4cc6-b5ee-1cb92542654e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:36.811872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ffaf4-d535-4cc6-b5ee-1cb92542654e service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:36.812158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ffaf4-d535-4cc6-b5ee-1cb92542654e service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:36.812468 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ffaf4-d535-4cc6-b5ee-1cb92542654e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:36.814094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-be1ffaf4-d535-4cc6-b5ee-1cb92542654e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:36.917186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ffaf4-d535-4cc6-b5ee-1cb92542654e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:36.919249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ffaf4-d535-4cc6-b5ee-1cb92542654e service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:36.936415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 594/1213] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:19:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:19:39.332775 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89e4f0-1ab7-425e-8da3-67e0d685cd41 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:39.333314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89e4f0-1ab7-425e-8da3-67e0d685cd41 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:39.333314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89e4f0-1ab7-425e-8da3-67e0d685cd41 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:39.335108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 620/1214] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:19:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:39.341344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ac2bb-715a-4d0b-aa27-5975866256d2 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:39.341761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ac2bb-715a-4d0b-aa27-5975866256d2 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:39.341905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ac2bb-715a-4d0b-aa27-5975866256d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:39.403442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-2b8ac2bb-715a-4d0b-aa27-5975866256d2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:39.404629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2b8ac2bb-715a-4d0b-aa27-5975866256d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:39.494607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 595/1215] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:19:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:19:39.529529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89e4f0-1ab7-425e-8da3-67e0d685cd41 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:39.531078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ce89e4f0-1ab7-425e-8da3-67e0d685cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:39.647193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89e4f0-1ab7-425e-8da3-67e0d685cd41 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:39.733508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8e847-7006-44e9-ab2b-df0134bf49eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:39.734336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8e847-7006-44e9-ab2b-df0134bf49eb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:39.734613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8e847-7006-44e9-ab2b-df0134bf49eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:39.734910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8e847-7006-44e9-ab2b-df0134bf49eb admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:39.744126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8e847-7006-44e9-ab2b-df0134bf49eb admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:39.746188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8e847-7006-44e9-ab2b-df0134bf49eb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:39.747847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 621/1216] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:19:39 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:19:39.760191 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ac2bb-715a-4d0b-aa27-5975866256d2 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:39.762157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2b8ac2bb-715a-4d0b-aa27-5975866256d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:39.849542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ac2bb-715a-4d0b-aa27-5975866256d2 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:39.919175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a881f91-f872-4ee0-bbb1-5619e37a1ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:39.919812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a881f91-f872-4ee0-bbb1-5619e37a1ccb service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:39.920093 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a881f91-f872-4ee0-bbb1-5619e37a1ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:39.920364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a881f91-f872-4ee0-bbb1-5619e37a1ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:39.921967 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3a881f91-f872-4ee0-bbb1-5619e37a1ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:40.023860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a881f91-f872-4ee0-bbb1-5619e37a1ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:40.025265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a881f91-f872-4ee0-bbb1-5619e37a1ccb service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:40.042131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 596/1217] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:19:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:19:42.668855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee79e-bb88-434d-82ef-e75946f73821 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:42.669461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee79e-bb88-434d-82ef-e75946f73821 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:42.669461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ee79e-bb88-434d-82ef-e75946f73821 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:42.671201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 622/1218] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:19:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:42.676985 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5452407-e3a0-4f8c-8ddf-14b4b645afd4 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:42.677440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5452407-e3a0-4f8c-8ddf-14b4b645afd4 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:42.677551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5452407-e3a0-4f8c-8ddf-14b4b645afd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:42.738656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d5452407-e3a0-4f8c-8ddf-14b4b645afd4 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:42.739867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d5452407-e3a0-4f8c-8ddf-14b4b645afd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:42.833583 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 597/1219] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:19:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:19:42.866586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ee79e-bb88-434d-82ef-e75946f73821 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:42.868145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9e6ee79e-bb88-434d-82ef-e75946f73821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:42.987963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ee79e-bb88-434d-82ef-e75946f73821 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:43.076527 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729fca8-af49-4111-bb68-b6197e2765ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:43.077368 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729fca8-af49-4111-bb68-b6197e2765ab admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:43.077653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729fca8-af49-4111-bb68-b6197e2765ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:43.077927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729fca8-af49-4111-bb68-b6197e2765ab admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:43.087380 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729fca8-af49-4111-bb68-b6197e2765ab admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:43.089383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729fca8-af49-4111-bb68-b6197e2765ab admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:43.091071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 623/1220] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:19:42 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:19:43.103156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5452407-e3a0-4f8c-8ddf-14b4b645afd4 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:43.104356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d5452407-e3a0-4f8c-8ddf-14b4b645afd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:43.190192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5452407-e3a0-4f8c-8ddf-14b4b645afd4 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:43.258933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160eb6d-20e5-4d34-8e34-ac986cf99ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:43.259574 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160eb6d-20e5-4d34-8e34-ac986cf99ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:43.259859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160eb6d-20e5-4d34-8e34-ac986cf99ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:43.260135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160eb6d-20e5-4d34-8e34-ac986cf99ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:43.262524 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7160eb6d-20e5-4d34-8e34-ac986cf99ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:43.365277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160eb6d-20e5-4d34-8e34-ac986cf99ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:43.366615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160eb6d-20e5-4d34-8e34-ac986cf99ce8 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:43.383562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 598/1221] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:19:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:19:46.109906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b854fc-c17f-4639-ae7f-069241a1da70 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:46.110477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b854fc-c17f-4639-ae7f-069241a1da70 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:46.110477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b854fc-c17f-4639-ae7f-069241a1da70 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:46.112379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 624/1222] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:19:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:46.118009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7b1f2-369b-400e-bada-84ed9cb94772 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:46.118463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7b1f2-369b-400e-bada-84ed9cb94772 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:46.118556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7b1f2-369b-400e-bada-84ed9cb94772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:46.182447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b1a7b1f2-369b-400e-bada-84ed9cb94772 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:46.184135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b1a7b1f2-369b-400e-bada-84ed9cb94772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:46.284134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 599/1223] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:19:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:19:46.320305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b854fc-c17f-4639-ae7f-069241a1da70 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:46.321962 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d0b854fc-c17f-4639-ae7f-069241a1da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:46.425858 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b854fc-c17f-4639-ae7f-069241a1da70 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:46.497267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f622d59-60b7-4cf2-a899-127cc0955939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:46.497922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f622d59-60b7-4cf2-a899-127cc0955939 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:46.498208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f622d59-60b7-4cf2-a899-127cc0955939 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:46.498485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f622d59-60b7-4cf2-a899-127cc0955939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:46.500138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3f622d59-60b7-4cf2-a899-127cc0955939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:46.605170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f622d59-60b7-4cf2-a899-127cc0955939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:46.606558 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f622d59-60b7-4cf2-a899-127cc0955939 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:46.625081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 625/1224] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:19:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:19:48.797760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8b6b-1c25-47bb-b2f2-190284a8e488 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:48.798286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8b6b-1c25-47bb-b2f2-190284a8e488 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:48.798286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8b6b-1c25-47bb-b2f2-190284a8e488 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:48.800069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 600/1225] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:19:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:48.805935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342134-91e5-4436-95f7-65546ae00f23 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:48.806342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342134-91e5-4436-95f7-65546ae00f23 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:48.806491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342134-91e5-4436-95f7-65546ae00f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:48.868069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-eb342134-91e5-4436-95f7-65546ae00f23 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:48.869191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-eb342134-91e5-4436-95f7-65546ae00f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:48.961491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 626/1226] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:19:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:19:48.998851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8b6b-1c25-47bb-b2f2-190284a8e488 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:49.000389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ecdb8b6b-1c25-47bb-b2f2-190284a8e488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:49.098158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8b6b-1c25-47bb-b2f2-190284a8e488 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:49.166628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd23a85-88d9-424b-9234-88ed091a02e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:49.167340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd23a85-88d9-424b-9234-88ed091a02e5 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:49.168143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd23a85-88d9-424b-9234-88ed091a02e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:49.168416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd23a85-88d9-424b-9234-88ed091a02e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:49.170028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-acd23a85-88d9-424b-9234-88ed091a02e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:49.276310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd23a85-88d9-424b-9234-88ed091a02e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:49.278385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd23a85-88d9-424b-9234-88ed091a02e5 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:49.297304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 601/1227] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:19:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:19:51.464038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bc12f-43a1-4e03-99dd-0c77cc45e54c None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:51.465130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bc12f-43a1-4e03-99dd-0c77cc45e54c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:51.465223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bc12f-43a1-4e03-99dd-0c77cc45e54c None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:51.467387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 627/1228] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:19:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:51.473240 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb8116-28c0-48c2-8dd6-b39fa540ab7f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:51.473650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb8116-28c0-48c2-8dd6-b39fa540ab7f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:51.473789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb8116-28c0-48c2-8dd6-b39fa540ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:51.540807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-11bb8116-28c0-48c2-8dd6-b39fa540ab7f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:51.542053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-11bb8116-28c0-48c2-8dd6-b39fa540ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:51.638059 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 602/1229] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:19:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:19:51.670109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bc12f-43a1-4e03-99dd-0c77cc45e54c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:51.671682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8e6bc12f-43a1-4e03-99dd-0c77cc45e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:51.792613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bc12f-43a1-4e03-99dd-0c77cc45e54c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:51.887100 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf56fa-f258-47e4-9d55-2c53b16e62a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:51.887947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf56fa-f258-47e4-9d55-2c53b16e62a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:51.888226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf56fa-f258-47e4-9d55-2c53b16e62a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:51.888494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf56fa-f258-47e4-9d55-2c53b16e62a3 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:51.897791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf56fa-f258-47e4-9d55-2c53b16e62a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:51.899885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf56fa-f258-47e4-9d55-2c53b16e62a3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:51.901731 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 628/1230] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:19:51 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:19:51.913547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb8116-28c0-48c2-8dd6-b39fa540ab7f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:51.914752 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-11bb8116-28c0-48c2-8dd6-b39fa540ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:51.999643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb8116-28c0-48c2-8dd6-b39fa540ab7f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:52.069118 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6cbc6-0b7f-4050-9798-0859c06a9a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:52.069765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6cbc6-0b7f-4050-9798-0859c06a9a62 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:52.070043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6cbc6-0b7f-4050-9798-0859c06a9a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:52.070311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6cbc6-0b7f-4050-9798-0859c06a9a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:52.071951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5da6cbc6-0b7f-4050-9798-0859c06a9a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:52.177658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6cbc6-0b7f-4050-9798-0859c06a9a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:52.180321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6cbc6-0b7f-4050-9798-0859c06a9a62 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:52.198644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 603/1231] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:19:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:19:54.571363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba4e4-f098-47c4-8b41-18c1d4ac6f6b None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:54.571867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba4e4-f098-47c4-8b41-18c1d4ac6f6b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:54.571977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba4e4-f098-47c4-8b41-18c1d4ac6f6b None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:54.574140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 629/1232] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:19:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:54.580042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3475bba-43b9-4be5-afbd-891cd3324b9e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:54.580450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3475bba-43b9-4be5-afbd-891cd3324b9e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:54.580593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3475bba-43b9-4be5-afbd-891cd3324b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:54.643361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a3475bba-43b9-4be5-afbd-891cd3324b9e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:54.644555 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a3475bba-43b9-4be5-afbd-891cd3324b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:54.735213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 604/1233] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:19:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:19:54.786138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de7ff-50ec-479e-8f52-7f0c8bbf9b8b None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:54.786428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de7ff-50ec-479e-8f52-7f0c8bbf9b8b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:54.786743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2de7ff-50ec-479e-8f52-7f0c8bbf9b8b None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:54.788508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 630/1234] 10.222.0.23 () {54 vars in 964 bytes} [Wed Aug 25 01:19:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:54.794503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd998-5596-4d6a-a4f7-f2e97e6b8ee1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:54.794937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd998-5596-4d6a-a4f7-f2e97e6b8ee1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:54.795345 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd998-5596-4d6a-a4f7-f2e97e6b8ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:54.865052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b56cd998-5596-4d6a-a4f7-f2e97e6b8ee1 None None] MFA Rules not processed for user `a08ace1a65c040bf97108a1660f962ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:54.866230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b56cd998-5596-4d6a-a4f7-f2e97e6b8ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:54.936333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 605/1235] 10.222.0.23 () {58 vars in 1062 bytes} [Wed Aug 25 01:19:54 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:19:54.945394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de7ff-50ec-479e-8f52-7f0c8bbf9b8b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:54.946959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-da2de7ff-50ec-479e-8f52-7f0c8bbf9b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:55.045298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2de7ff-50ec-479e-8f52-7f0c8bbf9b8b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:55.113284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bdbe4-e5ea-4189-b246-6cc5378a619a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:55.113919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bdbe4-e5ea-4189-b246-6cc5378a619a service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:55.114207 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bdbe4-e5ea-4189-b246-6cc5378a619a service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:55.114487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bdbe4-e5ea-4189-b246-6cc5378a619a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:55.116099 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-102bdbe4-e5ea-4189-b246-6cc5378a619a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:55.217741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bdbe4-e5ea-4189-b246-6cc5378a619a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:55.219197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bdbe4-e5ea-4189-b246-6cc5378a619a service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:55.236715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 631/1236] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:19:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:19:57.606271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e65b0-c7fb-4009-9a50-0711962e0ab2 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:57.606827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e65b0-c7fb-4009-9a50-0711962e0ab2 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:57.606827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e65b0-c7fb-4009-9a50-0711962e0ab2 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:57.608536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 606/1237] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:19:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:19:57.614370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74fe8-1f80-4f7e-bfb7-3e20a8a6dc60 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:57.614820 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74fe8-1f80-4f7e-bfb7-3e20a8a6dc60 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:57.614961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74fe8-1f80-4f7e-bfb7-3e20a8a6dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:57.678046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-87b74fe8-1f80-4f7e-bfb7-3e20a8a6dc60 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:19:57.679262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-87b74fe8-1f80-4f7e-bfb7-3e20a8a6dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:57.769497 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 632/1238] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:19:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:19:57.810780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e65b0-c7fb-4009-9a50-0711962e0ab2 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:19:57.812311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-284e65b0-c7fb-4009-9a50-0711962e0ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:57.910904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e65b0-c7fb-4009-9a50-0711962e0ab2 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:19:57.979370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635cd1b-d3a3-4465-b880-80ed5520ff10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:19:57.980052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635cd1b-d3a3-4465-b880-80ed5520ff10 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:19:57.980340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635cd1b-d3a3-4465-b880-80ed5520ff10 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:19:57.980619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635cd1b-d3a3-4465-b880-80ed5520ff10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:19:57.982231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d635cd1b-d3a3-4465-b880-80ed5520ff10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:19:58.085368 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635cd1b-d3a3-4465-b880-80ed5520ff10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:19:58.086798 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635cd1b-d3a3-4465-b880-80ed5520ff10 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:19:58.103656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 607/1239] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:19:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:00.847270 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78038d88-f985-4552-86c3-5ce25b40ad44 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:00.847783 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78038d88-f985-4552-86c3-5ce25b40ad44 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:00.847887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78038d88-f985-4552-86c3-5ce25b40ad44 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:00.849560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 633/1240] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:00.855968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18100aee-0d58-49d7-bc0b-a27bbc2c17b7 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:00.856415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18100aee-0d58-49d7-bc0b-a27bbc2c17b7 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:00.856523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18100aee-0d58-49d7-bc0b-a27bbc2c17b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:00.919447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-18100aee-0d58-49d7-bc0b-a27bbc2c17b7 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:00.920645 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-18100aee-0d58-49d7-bc0b-a27bbc2c17b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:01.019520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 608/1241] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:01.056548 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78038d88-f985-4552-86c3-5ce25b40ad44 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:01.058640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-78038d88-f985-4552-86c3-5ce25b40ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:01.160066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78038d88-f985-4552-86c3-5ce25b40ad44 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:01.163631 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ff5bf-e44c-49c6-b587-4f36b2c5069e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:01.164257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff5bf-e44c-49c6-b587-4f36b2c5069e service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:01.164537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff5bf-e44c-49c6-b587-4f36b2c5069e service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:01.164809 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff5bf-e44c-49c6-b587-4f36b2c5069e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:01.195106 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ff5bf-e44c-49c6-b587-4f36b2c5069e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:01.196542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ff5bf-e44c-49c6-b587-4f36b2c5069e service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:01.206122 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 634/1242] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:05.181519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6d87f-c95a-4925-9397-019528dc41d7 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:05.182077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6d87f-c95a-4925-9397-019528dc41d7 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:05.182077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6d87f-c95a-4925-9397-019528dc41d7 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:05.184392 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 609/1243] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:05.190303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9aff9-e19c-4c56-a573-cb3a74a8e0b2 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:05.190767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9aff9-e19c-4c56-a573-cb3a74a8e0b2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:05.190888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9aff9-e19c-4c56-a573-cb3a74a8e0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:05.246471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-05b9aff9-e19c-4c56-a573-cb3a74a8e0b2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:05.247585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-05b9aff9-e19c-4c56-a573-cb3a74a8e0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:05.264443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 635/1244] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:05.304026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6d87f-c95a-4925-9397-019528dc41d7 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:05.314268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6d87f-c95a-4925-9397-019528dc41d7 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:05.317700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1ac4-c096-41ad-8b4c-223795587825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:05.318326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1ac4-c096-41ad-8b4c-223795587825 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:05.318606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1ac4-c096-41ad-8b4c-223795587825 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:05.318912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1ac4-c096-41ad-8b4c-223795587825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:05.327443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1ac4-c096-41ad-8b4c-223795587825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:05.328851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1ac4-c096-41ad-8b4c-223795587825 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:05.338125 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 610/1245] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:08.019271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206693-4c8a-44f3-998e-a4142d6dd764 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:08.019814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206693-4c8a-44f3-998e-a4142d6dd764 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:08.019814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206693-4c8a-44f3-998e-a4142d6dd764 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:08.021587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 636/1246] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:08.027299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d891b-07d3-4fa4-9ced-f1526524ea32 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:08.027711 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d891b-07d3-4fa4-9ced-f1526524ea32 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:08.027998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d891b-07d3-4fa4-9ced-f1526524ea32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:08.045783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-457d891b-07d3-4fa4-9ced-f1526524ea32 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:08.047000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-457d891b-07d3-4fa4-9ced-f1526524ea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:08.054655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 611/1247] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:08.092773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87206693-4c8a-44f3-998e-a4142d6dd764 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:08.103161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87206693-4c8a-44f3-998e-a4142d6dd764 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:08.107144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d3aac-6634-452d-a570-51b1d4f88a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:08.107778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d3aac-6634-452d-a570-51b1d4f88a59 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:08.108061 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d3aac-6634-452d-a570-51b1d4f88a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:08.108340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d3aac-6634-452d-a570-51b1d4f88a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:08.117078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d3aac-6634-452d-a570-51b1d4f88a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:08.118500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d3aac-6634-452d-a570-51b1d4f88a59 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:08.128204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 637/1248] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:12.323418 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44f0ce-a91c-4434-8432-c7686ec5029e None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:12.324012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44f0ce-a91c-4434-8432-c7686ec5029e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:12.324012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44f0ce-a91c-4434-8432-c7686ec5029e None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:12.325729 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 612/1249] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:20:12.331927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071cb44-5ec4-4f61-a398-54dcad3d88b2 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:12.332395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071cb44-5ec4-4f61-a398-54dcad3d88b2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:12.332484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071cb44-5ec4-4f61-a398-54dcad3d88b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:12.350199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-5071cb44-5ec4-4f61-a398-54dcad3d88b2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:12.351413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5071cb44-5ec4-4f61-a398-54dcad3d88b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:12.360060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 638/1250] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:12.398432 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44f0ce-a91c-4434-8432-c7686ec5029e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:12.409368 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44f0ce-a91c-4434-8432-c7686ec5029e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:12.412810 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572aab-7488-4ca8-b0bc-9d3739406abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:12.413441 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572aab-7488-4ca8-b0bc-9d3739406abb service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:12.413722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572aab-7488-4ca8-b0bc-9d3739406abb service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:12.414008 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572aab-7488-4ca8-b0bc-9d3739406abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:12.423235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99572aab-7488-4ca8-b0bc-9d3739406abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:12.424657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99572aab-7488-4ca8-b0bc-9d3739406abb service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:12.433749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 613/1251] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:17.457307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4244ae-9192-4022-8817-e629dbc533b2 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:17.458508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4244ae-9192-4022-8817-e629dbc533b2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:17.463867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4244ae-9192-4022-8817-e629dbc533b2 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:17.467280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 639/1252] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 25 01:20:17 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:17.471926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aee6e-c76b-4568-a601-04c30980cbbd None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:17.472804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aee6e-c76b-4568-a601-04c30980cbbd None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:17.473311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aee6e-c76b-4568-a601-04c30980cbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:17.573578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-2e7aee6e-c76b-4568-a601-04c30980cbbd None None] MFA Rules not processed for user `40b49222a8e4474bbe14019418ec8aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:17.575342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2e7aee6e-c76b-4568-a601-04c30980cbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:17.652340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 614/1253] 10.222.0.23 () {58 vars in 1019 bytes} [Wed Aug 25 01:20:17 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:21.932221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87a62f-1192-4829-8bc6-3b2a2960e1ee None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:21.932785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87a62f-1192-4829-8bc6-3b2a2960e1ee None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:21.932785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87a62f-1192-4829-8bc6-3b2a2960e1ee None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:21.934766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 640/1254] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 25 01:20:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:21.940612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fd3fc-62b5-458b-970e-c5c173c6b4bb None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:21.941340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fd3fc-62b5-458b-970e-c5c173c6b4bb None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:21.941340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fd3fc-62b5-458b-970e-c5c173c6b4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:21.959202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-229fd3fc-62b5-458b-970e-c5c173c6b4bb None None] MFA Rules not processed for user `40b49222a8e4474bbe14019418ec8aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:21.960476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-229fd3fc-62b5-458b-970e-c5c173c6b4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:21.969312 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 615/1255] 10.222.0.23 () {58 vars in 1019 bytes} [Wed Aug 25 01:20:21 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:23.385459 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84bf0-d94b-495f-896e-a3006b50a5c2 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:23.386005 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84bf0-d94b-495f-896e-a3006b50a5c2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:23.386124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84bf0-d94b-495f-896e-a3006b50a5c2 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:23.388476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 641/1256] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 25 01:20:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:23.393524 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01119c6-c223-44be-91d4-55c4b398ecbf None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:23.393980 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01119c6-c223-44be-91d4-55c4b398ecbf None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:23.394078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01119c6-c223-44be-91d4-55c4b398ecbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:23.414317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c01119c6-c223-44be-91d4-55c4b398ecbf None None] MFA Rules not processed for user `40b49222a8e4474bbe14019418ec8aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:23.416391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c01119c6-c223-44be-91d4-55c4b398ecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:23.425740 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 616/1257] 10.222.0.23 () {58 vars in 1019 bytes} [Wed Aug 25 01:20:23 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:27.220911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb38c2-426a-4192-9c4f-d87c4e92c545 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:27.221418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb38c2-426a-4192-9c4f-d87c4e92c545 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:27.221418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb38c2-426a-4192-9c4f-d87c4e92c545 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:27.223318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 642/1258] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:27.229196 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4cbd4-e062-438c-8b19-153d8abcbd2c None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:27.229716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4cbd4-e062-438c-8b19-153d8abcbd2c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:27.229716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4cbd4-e062-438c-8b19-153d8abcbd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:27.247602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b0e4cbd4-e062-438c-8b19-153d8abcbd2c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:27.248781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b0e4cbd4-e062-438c-8b19-153d8abcbd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:27.271099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 617/1259] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:27.308443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a318785-fb77-477e-be72-97703b62c53d None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:27.308921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a318785-fb77-477e-be72-97703b62c53d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:27.309362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a318785-fb77-477e-be72-97703b62c53d None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:27.311333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 643/1260] 10.222.0.23 () {54 vars in 961 bytes} [Wed Aug 25 01:20:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:27.317902 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee599469-b9b7-444a-b782-44819c311906 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:27.318376 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee599469-b9b7-444a-b782-44819c311906 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:27.318781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee599469-b9b7-444a-b782-44819c311906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:27.368124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-ee599469-b9b7-444a-b782-44819c311906 None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:27.369906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ee599469-b9b7-444a-b782-44819c311906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:27.449572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 618/1261] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Aug 25 01:20:27 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:27.457465 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a318785-fb77-477e-be72-97703b62c53d None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:27.471265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a318785-fb77-477e-be72-97703b62c53d None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:27.476451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad985d12-f271-4495-82ce-5c735b91d7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:27.477101 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985d12-f271-4495-82ce-5c735b91d7cb service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:27.477381 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985d12-f271-4495-82ce-5c735b91d7cb service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:27.477651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985d12-f271-4495-82ce-5c735b91d7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:27.488731 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad985d12-f271-4495-82ce-5c735b91d7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:27.490490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad985d12-f271-4495-82ce-5c735b91d7cb service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:27.500187 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 644/1262] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:29.852336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f018-8936-427c-8593-2ffd2453b9be None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:29.853011 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f018-8936-427c-8593-2ffd2453b9be None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:29.853011 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f018-8936-427c-8593-2ffd2453b9be None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:29.862214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbc397-998f-427b-8190-8b17b0484573 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:29.865141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbc397-998f-427b-8190-8b17b0484573 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:29.865741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbc397-998f-427b-8190-8b17b0484573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:29.869092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 619/1263] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:29 2021] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:29.887771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-eddbc397-998f-427b-8190-8b17b0484573 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:29.889400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-eddbc397-998f-427b-8190-8b17b0484573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:29.914728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 645/1264] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:29.944033 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701f018-8936-427c-8593-2ffd2453b9be None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:29.959633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701f018-8936-427c-8593-2ffd2453b9be None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:29.965995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978f4d1-b7c8-4465-a65f-ba1fea2be0ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:29.966869 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f4d1-b7c8-4465-a65f-ba1fea2be0ea service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:29.967611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f4d1-b7c8-4465-a65f-ba1fea2be0ea service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:29.968071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f4d1-b7c8-4465-a65f-ba1fea2be0ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:29.976427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978f4d1-b7c8-4465-a65f-ba1fea2be0ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:29.978467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978f4d1-b7c8-4465-a65f-ba1fea2be0ea service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:29.988988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 620/1265] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:32.463444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1ced1-25cf-4b4a-adb5-75286e05b2e2 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:32.463868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1ced1-25cf-4b4a-adb5-75286e05b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:32.464071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1ced1-25cf-4b4a-adb5-75286e05b2e2 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:32.465876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 646/1266] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:32.471780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bf982-345a-48d4-925c-152a0773f84a None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:32.472561 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bf982-345a-48d4-925c-152a0773f84a None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:32.472843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bf982-345a-48d4-925c-152a0773f84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:32.491636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b46bf982-345a-48d4-925c-152a0773f84a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:32.492832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b46bf982-345a-48d4-925c-152a0773f84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:32.500581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 621/1267] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:32.547301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c08dca-83c8-40d7-8706-06115db99815 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:32.547594 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c08dca-83c8-40d7-8706-06115db99815 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:32.547882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c08dca-83c8-40d7-8706-06115db99815 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:32.549652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 647/1268] 10.222.0.23 () {54 vars in 961 bytes} [Wed Aug 25 01:20:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:32.555292 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc534e-62d2-4235-a322-93186ab91ff3 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:32.555700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc534e-62d2-4235-a322-93186ab91ff3 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:32.556069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc534e-62d2-4235-a322-93186ab91ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:32.578172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-e9cc534e-62d2-4235-a322-93186ab91ff3 None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:32.578172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e9cc534e-62d2-4235-a322-93186ab91ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:32.585642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 622/1269] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Aug 25 01:20:32 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:20:32.595777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c08dca-83c8-40d7-8706-06115db99815 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:32.610080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c08dca-83c8-40d7-8706-06115db99815 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:32.615721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7b41f-b28e-4f07-b497-af572c57064d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:32.616357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b41f-b28e-4f07-b497-af572c57064d service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:32.616642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b41f-b28e-4f07-b497-af572c57064d service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:32.616922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b41f-b28e-4f07-b497-af572c57064d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:32.624992 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7b41f-b28e-4f07-b497-af572c57064d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:32.626574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7b41f-b28e-4f07-b497-af572c57064d service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:32.636005 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 648/1270] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:20:34.837677 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9016a3-3b31-4031-bd55-1eccab7eac3e None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:34.838211 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9016a3-3b31-4031-bd55-1eccab7eac3e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:34.838211 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9016a3-3b31-4031-bd55-1eccab7eac3e None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:34.839896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 623/1271] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:34.845967 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df23aa-894f-4c37-b281-3070fed026b6 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:34.846383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df23aa-894f-4c37-b281-3070fed026b6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:34.846519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df23aa-894f-4c37-b281-3070fed026b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:34.864556 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a8df23aa-894f-4c37-b281-3070fed026b6 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:34.865900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a8df23aa-894f-4c37-b281-3070fed026b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:34.874719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 649/1272] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:34.922447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9016a3-3b31-4031-bd55-1eccab7eac3e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:34.937067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9016a3-3b31-4031-bd55-1eccab7eac3e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:34.942333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d1a69-edad-4de8-8418-b992dd1bbcf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:34.942998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1a69-edad-4de8-8418-b992dd1bbcf1 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:34.943280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1a69-edad-4de8-8418-b992dd1bbcf1 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:34.943550 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1a69-edad-4de8-8418-b992dd1bbcf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:34.951761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d1a69-edad-4de8-8418-b992dd1bbcf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:34.953323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d1a69-edad-4de8-8418-b992dd1bbcf1 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:34.962671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 624/1273] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:34.980421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913a4cb-72a1-4327-89bc-b11e68602eee None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:34.980716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913a4cb-72a1-4327-89bc-b11e68602eee None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:34.980985 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913a4cb-72a1-4327-89bc-b11e68602eee None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:34.982916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 650/1274] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:34.989312 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08345-6100-4a22-8d1c-6a655d019ae1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:34.990775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08345-6100-4a22-8d1c-6a655d019ae1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:34.990775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08345-6100-4a22-8d1c-6a655d019ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:35.009046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-16b08345-6100-4a22-8d1c-6a655d019ae1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:35.010789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-16b08345-6100-4a22-8d1c-6a655d019ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:35.018566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 625/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:35.078453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97681e6-f028-4228-808c-fe736b4b9e33 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:35.078986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97681e6-f028-4228-808c-fe736b4b9e33 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:35.079469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97681e6-f028-4228-808c-fe736b4b9e33 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:35.081363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 651/1276] 10.222.0.23 () {54 vars in 966 bytes} [Wed Aug 25 01:20:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:35.087451 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb01bf-0b04-4cf3-b967-273872d0bdb7 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:35.087921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb01bf-0b04-4cf3-b967-273872d0bdb7 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:35.088241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb01bf-0b04-4cf3-b967-273872d0bdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:35.145717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-9dcb01bf-0b04-4cf3-b967-273872d0bdb7 None None] MFA Rules not processed for user `1dde8359945b45bbbf5d3a27964a7f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:35.147153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-9dcb01bf-0b04-4cf3-b967-273872d0bdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:35.223715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 626/1277] 10.222.0.23 () {58 vars in 1064 bytes} [Wed Aug 25 01:20:35 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:35.231962 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97681e6-f028-4228-808c-fe736b4b9e33 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:35.242228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97681e6-f028-4228-808c-fe736b4b9e33 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:35.246305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da109b-caff-4efc-a844-f0171243450b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:35.246962 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da109b-caff-4efc-a844-f0171243450b service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:35.247244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da109b-caff-4efc-a844-f0171243450b service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:35.247516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da109b-caff-4efc-a844-f0171243450b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:35.256510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da109b-caff-4efc-a844-f0171243450b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:35.258077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da109b-caff-4efc-a844-f0171243450b service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:35.268271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 652/1278] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:37.175427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fc992-bf89-45c2-929d-04415c9e64a6 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:37.175427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fc992-bf89-45c2-929d-04415c9e64a6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:37.175963 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fc992-bf89-45c2-929d-04415c9e64a6 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:37.177424 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 627/1279] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:37.183495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774eb8c-eb3e-4fb7-ae95-5935d7369dd6 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:37.183917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774eb8c-eb3e-4fb7-ae95-5935d7369dd6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:37.184065 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774eb8c-eb3e-4fb7-ae95-5935d7369dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:37.203790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8774eb8c-eb3e-4fb7-ae95-5935d7369dd6 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:37.204922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8774eb8c-eb3e-4fb7-ae95-5935d7369dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:37.213482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 653/1280] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:37.259682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fc992-bf89-45c2-929d-04415c9e64a6 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:37.274196 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fc992-bf89-45c2-929d-04415c9e64a6 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:37.280103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088cbd3-cf77-4566-9d8c-def8a63fdc37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:37.280745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088cbd3-cf77-4566-9d8c-def8a63fdc37 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:37.281033 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088cbd3-cf77-4566-9d8c-def8a63fdc37 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:37.281310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088cbd3-cf77-4566-9d8c-def8a63fdc37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:37.289724 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088cbd3-cf77-4566-9d8c-def8a63fdc37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:37.291743 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088cbd3-cf77-4566-9d8c-def8a63fdc37 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:37.301837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 628/1281] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:39.509753 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5c391-4c4a-45de-9c64-f8879973a143 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:39.510197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5c391-4c4a-45de-9c64-f8879973a143 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:39.510309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5c391-4c4a-45de-9c64-f8879973a143 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:39.512077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 654/1282] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:39.518036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cf57-3adc-4e94-8ef6-6da43b0ae738 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:39.518443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cf57-3adc-4e94-8ef6-6da43b0ae738 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:39.518600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cf57-3adc-4e94-8ef6-6da43b0ae738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:39.536181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-20f4cf57-3adc-4e94-8ef6-6da43b0ae738 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:39.537369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-20f4cf57-3adc-4e94-8ef6-6da43b0ae738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:39.545775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 629/1283] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:39.590464 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5c391-4c4a-45de-9c64-f8879973a143 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:39.604985 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5c391-4c4a-45de-9c64-f8879973a143 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:39.610586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaa9ee-653a-4d93-ab21-0f37080f632d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:39.611351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaa9ee-653a-4d93-ab21-0f37080f632d service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:39.611697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaa9ee-653a-4d93-ab21-0f37080f632d service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:39.612037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaa9ee-653a-4d93-ab21-0f37080f632d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:39.620659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eaa9ee-653a-4d93-ab21-0f37080f632d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:39.622301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eaa9ee-653a-4d93-ab21-0f37080f632d service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:39.631494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 655/1284] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:41.811046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918c65-c167-45cb-bdd2-893850482127 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:41.811548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918c65-c167-45cb-bdd2-893850482127 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:41.811548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918c65-c167-45cb-bdd2-893850482127 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:41.813278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 630/1285] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:41.819214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61b200-9da4-4e02-b2f4-b8592ef0591d None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:41.819665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61b200-9da4-4e02-b2f4-b8592ef0591d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:41.819763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61b200-9da4-4e02-b2f4-b8592ef0591d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:41.838342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-4d61b200-9da4-4e02-b2f4-b8592ef0591d None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:41.839538 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4d61b200-9da4-4e02-b2f4-b8592ef0591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:41.847319 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 656/1286] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:20:41.889926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918c65-c167-45cb-bdd2-893850482127 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:41.904500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918c65-c167-45cb-bdd2-893850482127 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:41.909783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c116bcf-b3f9-457d-8a02-b4f274ae9de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:41.910521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116bcf-b3f9-457d-8a02-b4f274ae9de4 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:41.910880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116bcf-b3f9-457d-8a02-b4f274ae9de4 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:41.911159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116bcf-b3f9-457d-8a02-b4f274ae9de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:41.919946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c116bcf-b3f9-457d-8a02-b4f274ae9de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:41.921641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c116bcf-b3f9-457d-8a02-b4f274ae9de4 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:41.931271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 631/1287] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:44.066421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2925a-fc19-4a0a-a6b9-c7fc46c3c332 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:44.067197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2925a-fc19-4a0a-a6b9-c7fc46c3c332 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:44.067197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2925a-fc19-4a0a-a6b9-c7fc46c3c332 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:44.068758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 657/1288] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:44.075086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31b66f-4478-40dd-a871-1c37a1aff5e1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:44.075642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31b66f-4478-40dd-a871-1c37a1aff5e1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:44.075642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31b66f-4478-40dd-a871-1c37a1aff5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:44.093747 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-ab31b66f-4478-40dd-a871-1c37a1aff5e1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:44.094981 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ab31b66f-4478-40dd-a871-1c37a1aff5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:44.102727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 632/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:44.147893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2925a-fc19-4a0a-a6b9-c7fc46c3c332 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:44.163072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2925a-fc19-4a0a-a6b9-c7fc46c3c332 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:44.168668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70427b-8f53-4d31-b39a-b175f2a2cd68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:44.169323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70427b-8f53-4d31-b39a-b175f2a2cd68 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:44.169632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70427b-8f53-4d31-b39a-b175f2a2cd68 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:44.169930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70427b-8f53-4d31-b39a-b175f2a2cd68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:44.178500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70427b-8f53-4d31-b39a-b175f2a2cd68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:44.180165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70427b-8f53-4d31-b39a-b175f2a2cd68 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:44.189923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 658/1290] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:46.344454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a6936-6e88-492b-8cef-970a14d67862 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:46.345038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a6936-6e88-492b-8cef-970a14d67862 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:46.345038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a6936-6e88-492b-8cef-970a14d67862 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:46.347018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 633/1291] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:46.352853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548334-583b-494d-8c42-a6984f824ee5 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:46.353313 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548334-583b-494d-8c42-a6984f824ee5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:46.353444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548334-583b-494d-8c42-a6984f824ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:46.371526 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6a548334-583b-494d-8c42-a6984f824ee5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:46.372750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6a548334-583b-494d-8c42-a6984f824ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:46.380715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 659/1292] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:46.427309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a6936-6e88-492b-8cef-970a14d67862 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:46.441844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a6936-6e88-492b-8cef-970a14d67862 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:46.447872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001797-9d5a-4fcd-9725-fb91408407f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:46.448510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001797-9d5a-4fcd-9725-fb91408407f7 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:46.448794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001797-9d5a-4fcd-9725-fb91408407f7 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:46.449074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001797-9d5a-4fcd-9725-fb91408407f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:46.457530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001797-9d5a-4fcd-9725-fb91408407f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:46.459140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001797-9d5a-4fcd-9725-fb91408407f7 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:46.469057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 634/1293] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:20:48.937662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf52a1-e12f-4f9d-a85d-21ba00642835 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:48.938239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf52a1-e12f-4f9d-a85d-21ba00642835 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:48.938239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf52a1-e12f-4f9d-a85d-21ba00642835 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:48.939977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 660/1294] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:48.945782 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad40a5-5cdc-4e26-9deb-2b9fb5a05c5f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:48.946239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad40a5-5cdc-4e26-9deb-2b9fb5a05c5f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:48.946356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad40a5-5cdc-4e26-9deb-2b9fb5a05c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:48.964406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-22ad40a5-5cdc-4e26-9deb-2b9fb5a05c5f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:48.965586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-22ad40a5-5cdc-4e26-9deb-2b9fb5a05c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:48.973633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 635/1295] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:49.018471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf52a1-e12f-4f9d-a85d-21ba00642835 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:49.033228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf52a1-e12f-4f9d-a85d-21ba00642835 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:49.038740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300e977-6c87-4880-afd7-37c32b3b850b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:49.039373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e977-6c87-4880-afd7-37c32b3b850b service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:49.040272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e977-6c87-4880-afd7-37c32b3b850b service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:49.040551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e977-6c87-4880-afd7-37c32b3b850b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:49.048906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300e977-6c87-4880-afd7-37c32b3b850b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:49.050476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300e977-6c87-4880-afd7-37c32b3b850b service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:49.059628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 661/1296] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:20:49.889128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce4f20-4105-4e14-9a43-10838f21c79d None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:49.889344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce4f20-4105-4e14-9a43-10838f21c79d None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:49.889623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce4f20-4105-4e14-9a43-10838f21c79d None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:49.891479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 636/1297] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:49.897422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e31e3-f821-46bc-8ad7-11e372cff323 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:49.897713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e31e3-f821-46bc-8ad7-11e372cff323 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:49.898017 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e31e3-f821-46bc-8ad7-11e372cff323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:49.915740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-072e31e3-f821-46bc-8ad7-11e372cff323 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:49.916917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-072e31e3-f821-46bc-8ad7-11e372cff323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:49.924504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 662/1298] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:49.981246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3e24-3bbb-4d48-a3a1-b5fb52c2f728 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:49.981734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3e24-3bbb-4d48-a3a1-b5fb52c2f728 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:49.981839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3e24-3bbb-4d48-a3a1-b5fb52c2f728 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:49.983692 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 637/1299] 10.222.0.23 () {54 vars in 966 bytes} [Wed Aug 25 01:20:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:49.989110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb12391-e6a2-4079-8acb-bf5286493053 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:49.989536 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb12391-e6a2-4079-8acb-bf5286493053 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:49.989691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb12391-e6a2-4079-8acb-bf5286493053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:50.036397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7eb12391-e6a2-4079-8acb-bf5286493053 None None] MFA Rules not processed for user `c0b9d35e26e64c959e075622321df3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:50.037589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7eb12391-e6a2-4079-8acb-bf5286493053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:50.095490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 663/1300] 10.222.0.23 () {58 vars in 1064 bytes} [Wed Aug 25 01:20:49 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:50.103841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3e24-3bbb-4d48-a3a1-b5fb52c2f728 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:50.114123 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3e24-3bbb-4d48-a3a1-b5fb52c2f728 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:50.118274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a07457-5af2-48c7-89f6-a400439805a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b9d35e26e64c959e075622321df3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:50.118937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a07457-5af2-48c7-89f6-a400439805a8 service glance] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:50.119221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a07457-5af2-48c7-89f6-a400439805a8 service glance] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:50.119500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a07457-5af2-48c7-89f6-a400439805a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:50.128469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a07457-5af2-48c7-89f6-a400439805a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:50.129900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a07457-5af2-48c7-89f6-a400439805a8 service glance] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:50.139949 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 638/1301] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:50.575946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95ba29-25ac-4b99-88fc-9be9edc94ccd None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:50.576272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95ba29-25ac-4b99-88fc-9be9edc94ccd None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:50.576609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95ba29-25ac-4b99-88fc-9be9edc94ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:50.623894 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-3f95ba29-25ac-4b99-88fc-9be9edc94ccd None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:50.625058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3f95ba29-25ac-4b99-88fc-9be9edc94ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:50.685868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 664/1302] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:20:50 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:50.728068 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b243ea-41e2-4466-9e9a-602294a3072c None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:50.728356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b243ea-41e2-4466-9e9a-602294a3072c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:50.728635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b243ea-41e2-4466-9e9a-602294a3072c None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:50.730437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 639/1303] 10.222.0.23 () {54 vars in 942 bytes} [Wed Aug 25 01:20:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:50.737653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea1d79-f613-407f-8944-b4dc23ca16b0 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:50.737951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea1d79-f613-407f-8944-b4dc23ca16b0 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:50.738228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea1d79-f613-407f-8944-b4dc23ca16b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:50.787198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-5cea1d79-f613-407f-8944-b4dc23ca16b0 None None] MFA Rules not processed for user `861c258c3fbf470fac4af9966ac5f0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:50.788406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5cea1d79-f613-407f-8944-b4dc23ca16b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:50.856766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 665/1304] 10.222.0.23 () {58 vars in 1040 bytes} [Wed Aug 25 01:20:50 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:50.866506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b243ea-41e2-4466-9e9a-602294a3072c None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:50.879461 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b243ea-41e2-4466-9e9a-602294a3072c None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:50.885302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d23343-5f13-4caa-9906-a853ada24f5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:50.885939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d23343-5f13-4caa-9906-a853ada24f5a service swift] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:50.886220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d23343-5f13-4caa-9906-a853ada24f5a service swift] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:50.886526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d23343-5f13-4caa-9906-a853ada24f5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:50.894647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d23343-5f13-4caa-9906-a853ada24f5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:50.896228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d23343-5f13-4caa-9906-a853ada24f5a service swift] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:50.904521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 640/1305] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:20:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 01:20:51.230670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a9e6a-19ef-40da-8754-8f0cb58357b2 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:51.231235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a9e6a-19ef-40da-8754-8f0cb58357b2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:51.231504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a9e6a-19ef-40da-8754-8f0cb58357b2 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:51.233700 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 666/1306] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:51.239825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6426b3-0a9d-4952-85d8-e0eead36c6a6 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:51.240323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6426b3-0a9d-4952-85d8-e0eead36c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:51.240407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6426b3-0a9d-4952-85d8-e0eead36c6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:51.260030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-cf6426b3-0a9d-4952-85d8-e0eead36c6a6 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:51.261232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-cf6426b3-0a9d-4952-85d8-e0eead36c6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:51.268945 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 641/1307] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:51.316777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a9e6a-19ef-40da-8754-8f0cb58357b2 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:51.331889 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a9e6a-19ef-40da-8754-8f0cb58357b2 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:51.337401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7a2f0-e31c-4ee1-8662-2d4e4274708d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:51.338061 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a2f0-e31c-4ee1-8662-2d4e4274708d service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:51.338348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a2f0-e31c-4ee1-8662-2d4e4274708d service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:51.338625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a2f0-e31c-4ee1-8662-2d4e4274708d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:51.347053 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7a2f0-e31c-4ee1-8662-2d4e4274708d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:51.348715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7a2f0-e31c-4ee1-8662-2d4e4274708d service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:51.358647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 667/1308] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:20:53.548856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049fbf1-c2db-42bd-b7e2-1194db0feb52 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:53.549778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049fbf1-c2db-42bd-b7e2-1194db0feb52 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:53.550064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049fbf1-c2db-42bd-b7e2-1194db0feb52 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:53.551875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 642/1309] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:20:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:20:53.558137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571099a-a945-4dd8-9b49-0cb02edcdea8 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:53.558587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571099a-a945-4dd8-9b49-0cb02edcdea8 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:53.558931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571099a-a945-4dd8-9b49-0cb02edcdea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:53.577646 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-0571099a-a945-4dd8-9b49-0cb02edcdea8 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:20:53.579038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0571099a-a945-4dd8-9b49-0cb02edcdea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:20:53.590346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 668/1310] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:20:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:20:53.636753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049fbf1-c2db-42bd-b7e2-1194db0feb52 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:20:53.651448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049fbf1-c2db-42bd-b7e2-1194db0feb52 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:20:53.657113 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473b973-cad3-4d51-a321-c4a682ef85ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:20:53.657926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473b973-cad3-4d51-a321-c4a682ef85ec service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:20:53.658384 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473b973-cad3-4d51-a321-c4a682ef85ec service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:20:53.658846 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473b973-cad3-4d51-a321-c4a682ef85ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:20:53.668393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473b973-cad3-4d51-a321-c4a682ef85ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:20:53.670185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473b973-cad3-4d51-a321-c4a682ef85ec service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:20:53.681149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 643/1311] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:20:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:07.869962 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d58289-9239-4be9-86a1-cff273263df8 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:07.870492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d58289-9239-4be9-86a1-cff273263df8 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:07.870492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d58289-9239-4be9-86a1-cff273263df8 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:07.872254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 669/1312] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:07.878195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd79c51-3859-4fb7-b88f-f94a04940602 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:07.878617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd79c51-3859-4fb7-b88f-f94a04940602 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:07.878797 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd79c51-3859-4fb7-b88f-f94a04940602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:07.896866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-8cd79c51-3859-4fb7-b88f-f94a04940602 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:07.898089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8cd79c51-3859-4fb7-b88f-f94a04940602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:07.905759 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 644/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:07.930759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d58289-9239-4be9-86a1-cff273263df8 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:07.942663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d58289-9239-4be9-86a1-cff273263df8 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:07.947003 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c4336-9ab7-4ae4-b1db-bfbc9951e82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:07.947631 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c4336-9ab7-4ae4-b1db-bfbc9951e82f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:07.947910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c4336-9ab7-4ae4-b1db-bfbc9951e82f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:07.948181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c4336-9ab7-4ae4-b1db-bfbc9951e82f admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:07.948893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c4336-9ab7-4ae4-b1db-bfbc9951e82f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:07.950741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c4336-9ab7-4ae4-b1db-bfbc9951e82f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:07.968631 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 670/1314] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:21:07 2021] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:21:10.072589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01291acd-17f1-482e-8215-654f4dc59ca6 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:10.073171 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01291acd-17f1-482e-8215-654f4dc59ca6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:10.073171 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01291acd-17f1-482e-8215-654f4dc59ca6 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:10.074958 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 645/1315] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:10.080690 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea8a16-dbc9-4057-bccc-475f03843f0e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:10.081140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea8a16-dbc9-4057-bccc-475f03843f0e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:10.081234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea8a16-dbc9-4057-bccc-475f03843f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:10.099015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-f1ea8a16-dbc9-4057-bccc-475f03843f0e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:10.100206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f1ea8a16-dbc9-4057-bccc-475f03843f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:10.108346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 671/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:10.131377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01291acd-17f1-482e-8215-654f4dc59ca6 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:10.143615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01291acd-17f1-482e-8215-654f4dc59ca6 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:10.148455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35f3a-e4d0-4066-bf26-36e320c5e8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:10.149280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35f3a-e4d0-4066-bf26-36e320c5e8dd admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:10.149559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35f3a-e4d0-4066-bf26-36e320c5e8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:10.149830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35f3a-e4d0-4066-bf26-36e320c5e8dd admin admin] PATH_INFO: `/v3/projects/220c843aa1514b7390df45e1ecd50d12` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:10.151025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35f3a-e4d0-4066-bf26-36e320c5e8dd admin admin] RBAC: Authorizing `identity:get_project(project_id=220c843aa1514b7390df45e1ecd50d12)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:10.152787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35f3a-e4d0-4066-bf26-36e320c5e8dd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:10.154394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 646/1317] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:21:10 2021] GET /identity/v3/projects/220c843aa1514b7390df45e1ecd50d12 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:10.160489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea8a16-dbc9-4057-bccc-475f03843f0e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:10.169864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea8a16-dbc9-4057-bccc-475f03843f0e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:10.174316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f88d86-e614-412b-aee4-7d509fc2b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:10.174976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f88d86-e614-412b-aee4-7d509fc2b558 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:10.175258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f88d86-e614-412b-aee4-7d509fc2b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:10.175534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f88d86-e614-412b-aee4-7d509fc2b558 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:10.176278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f88d86-e614-412b-aee4-7d509fc2b558 admin admin] RBAC: Adding query filter params (scope.project.id=220c843aa1514b7390df45e1ecd50d12) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:21:10.176583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f88d86-e614-412b-aee4-7d509fc2b558 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:10.178391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f88d86-e614-412b-aee4-7d509fc2b558 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:10.184962 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 672/1318] 10.222.0.23 () {56 vars in 1232 bytes} [Wed Aug 25 01:21:10 2021] GET /identity/v3/role_assignments?scope.project.id=220c843aa1514b7390df45e1ecd50d12 => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:10.191135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35f3a-e4d0-4066-bf26-36e320c5e8dd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:10.201159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35f3a-e4d0-4066-bf26-36e320c5e8dd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:10.205712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4700a87-feae-437f-be18-ed83f42849ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:10.206542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4700a87-feae-437f-be18-ed83f42849ee admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:10.206861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4700a87-feae-437f-be18-ed83f42849ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:10.207141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4700a87-feae-437f-be18-ed83f42849ee admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:10.208294 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4700a87-feae-437f-be18-ed83f42849ee admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:10.210056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4700a87-feae-437f-be18-ed83f42849ee admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:10.212411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 647/1319] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:21:10 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:12.352603 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115ff68-96cd-46ea-9e2e-9c15b112336e None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:12.353169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115ff68-96cd-46ea-9e2e-9c15b112336e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:12.353169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115ff68-96cd-46ea-9e2e-9c15b112336e None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:12.354936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 673/1320] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:12.360678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02392-a3f0-4066-b8e5-cc035f33450f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:12.361110 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02392-a3f0-4066-b8e5-cc035f33450f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:12.361241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02392-a3f0-4066-b8e5-cc035f33450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:12.378903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c8d02392-a3f0-4066-b8e5-cc035f33450f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:12.380072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c8d02392-a3f0-4066-b8e5-cc035f33450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:12.388548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 648/1321] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:12.411726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115ff68-96cd-46ea-9e2e-9c15b112336e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:12.424342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115ff68-96cd-46ea-9e2e-9c15b112336e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:12.428797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d9e4-3d53-436f-8772-2f8442d2eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:12.430256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d9e4-3d53-436f-8772-2f8442d2eaaa admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:12.430539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d9e4-3d53-436f-8772-2f8442d2eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:12.430845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d9e4-3d53-436f-8772-2f8442d2eaaa admin admin] PATH_INFO: `/v3/projects/73f23529c97d4072a14818ca767c4258` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:12.441485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d9e4-3d53-436f-8772-2f8442d2eaaa admin admin] RBAC: Authorizing `identity:get_project(project_id=73f23529c97d4072a14818ca767c4258)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:12.443585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d9e4-3d53-436f-8772-2f8442d2eaaa admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:12.445218 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 674/1322] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:21:12 2021] GET /identity/v3/projects/73f23529c97d4072a14818ca767c4258 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:12.451459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02392-a3f0-4066-b8e5-cc035f33450f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:12.460060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02392-a3f0-4066-b8e5-cc035f33450f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:12.464575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701443-321e-42e9-8e55-d4e1f168638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:12.465198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701443-321e-42e9-8e55-d4e1f168638d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:12.465476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701443-321e-42e9-8e55-d4e1f168638d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:12.465748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701443-321e-42e9-8e55-d4e1f168638d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:12.466500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb701443-321e-42e9-8e55-d4e1f168638d admin admin] RBAC: Adding query filter params (scope.project.id=73f23529c97d4072a14818ca767c4258) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:21:12.466844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb701443-321e-42e9-8e55-d4e1f168638d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:12.468641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb701443-321e-42e9-8e55-d4e1f168638d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:12.476500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 649/1323] 10.222.0.23 () {56 vars in 1232 bytes} [Wed Aug 25 01:21:12 2021] GET /identity/v3/role_assignments?scope.project.id=73f23529c97d4072a14818ca767c4258 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:21:12.482526 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d9e4-3d53-436f-8772-2f8442d2eaaa admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:12.492632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d9e4-3d53-436f-8772-2f8442d2eaaa admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:12.497085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33106a0-8c9a-4c58-bd39-cbb02af3c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:12.497931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33106a0-8c9a-4c58-bd39-cbb02af3c053 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:12.498212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33106a0-8c9a-4c58-bd39-cbb02af3c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:12.498487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33106a0-8c9a-4c58-bd39-cbb02af3c053 admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:12.499676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33106a0-8c9a-4c58-bd39-cbb02af3c053 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:12.501449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33106a0-8c9a-4c58-bd39-cbb02af3c053 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:12.503050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 675/1324] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:21:12 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:12.509517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701443-321e-42e9-8e55-d4e1f168638d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:12.519135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701443-321e-42e9-8e55-d4e1f168638d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:12.523644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf139f4-51b1-4c3d-b29b-c396b92c3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:12.524493 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf139f4-51b1-4c3d-b29b-c396b92c3b9c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:12.524777 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf139f4-51b1-4c3d-b29b-c396b92c3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:12.525055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf139f4-51b1-4c3d-b29b-c396b92c3b9c admin admin] PATH_INFO: `/v3/users/a1775e58a71b4a74a4ffb567c605e7d2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:12.537934 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf139f4-51b1-4c3d-b29b-c396b92c3b9c admin admin] RBAC: Authorizing `identity:get_user(user_id=a1775e58a71b4a74a4ffb567c605e7d2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:12.540616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf139f4-51b1-4c3d-b29b-c396b92c3b9c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:12.542202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 650/1325] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:21:12 2021] GET /identity/v3/users/a1775e58a71b4a74a4ffb567c605e7d2 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:21:14.718320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae529-eb4f-4f27-8dfe-d04d8c66f2b7 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:14.718942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae529-eb4f-4f27-8dfe-d04d8c66f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:14.718942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae529-eb4f-4f27-8dfe-d04d8c66f2b7 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:14.720627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 676/1326] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:14.726727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7246b-5607-4d06-8803-220894b195ca None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:14.727169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7246b-5607-4d06-8803-220894b195ca None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:14.727277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7246b-5607-4d06-8803-220894b195ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:14.744085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-35b7246b-5607-4d06-8803-220894b195ca None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:14.745344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-35b7246b-5607-4d06-8803-220894b195ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:14.753052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 651/1327] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:14.777850 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae529-eb4f-4f27-8dfe-d04d8c66f2b7 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:14.790216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae529-eb4f-4f27-8dfe-d04d8c66f2b7 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:14.794552 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa78fc-1f73-481e-83fb-caa286496d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:14.795411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa78fc-1f73-481e-83fb-caa286496d34 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:14.795689 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa78fc-1f73-481e-83fb-caa286496d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:14.795960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa78fc-1f73-481e-83fb-caa286496d34 admin admin] PATH_INFO: `/v3/projects/749968f930fa45ba9591e86301e37c6b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:14.806118 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa78fc-1f73-481e-83fb-caa286496d34 admin admin] RBAC: Authorizing `identity:get_project(project_id=749968f930fa45ba9591e86301e37c6b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:14.808179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa78fc-1f73-481e-83fb-caa286496d34 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:14.809827 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 677/1328] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:21:14 2021] GET /identity/v3/projects/749968f930fa45ba9591e86301e37c6b => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:14.816343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7246b-5607-4d06-8803-220894b195ca None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:14.825668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7246b-5607-4d06-8803-220894b195ca None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:14.830121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080ce37-c076-49af-a6c7-25243a2646d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:14.830766 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080ce37-c076-49af-a6c7-25243a2646d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:14.831048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080ce37-c076-49af-a6c7-25243a2646d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:14.831321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080ce37-c076-49af-a6c7-25243a2646d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:14.832079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080ce37-c076-49af-a6c7-25243a2646d7 admin admin] RBAC: Adding query filter params (scope.project.id=749968f930fa45ba9591e86301e37c6b) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:21:14.832379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080ce37-c076-49af-a6c7-25243a2646d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:14.834228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080ce37-c076-49af-a6c7-25243a2646d7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:14.841445 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 652/1329] 10.222.0.23 () {56 vars in 1232 bytes} [Wed Aug 25 01:21:14 2021] GET /identity/v3/role_assignments?scope.project.id=749968f930fa45ba9591e86301e37c6b => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:21:14.847261 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa78fc-1f73-481e-83fb-caa286496d34 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:14.856492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa78fc-1f73-481e-83fb-caa286496d34 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:14.860928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f6eed-0fdd-4cc3-b511-6b5500731f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:14.861750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f6eed-0fdd-4cc3-b511-6b5500731f3b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:14.862031 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f6eed-0fdd-4cc3-b511-6b5500731f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:14.862305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f6eed-0fdd-4cc3-b511-6b5500731f3b admin admin] PATH_INFO: `/v3/users/3c48fa6914a840d99c4665f7fb9f25b2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:14.863483 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f6eed-0fdd-4cc3-b511-6b5500731f3b admin admin] RBAC: Authorizing `identity:get_user(user_id=3c48fa6914a840d99c4665f7fb9f25b2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:14.865222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f6eed-0fdd-4cc3-b511-6b5500731f3b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:14.866751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 678/1330] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:21:14 2021] GET /identity/v3/users/3c48fa6914a840d99c4665f7fb9f25b2 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:14.872575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080ce37-c076-49af-a6c7-25243a2646d7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:14.882331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080ce37-c076-49af-a6c7-25243a2646d7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:14.887019 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550cf3d-4d76-4ba0-80c6-9310ec3f2763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:14.887841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550cf3d-4d76-4ba0-80c6-9310ec3f2763 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:14.888119 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550cf3d-4d76-4ba0-80c6-9310ec3f2763 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:14.888391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550cf3d-4d76-4ba0-80c6-9310ec3f2763 admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:14.901850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550cf3d-4d76-4ba0-80c6-9310ec3f2763 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:14.903959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550cf3d-4d76-4ba0-80c6-9310ec3f2763 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:14.905522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 653/1331] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:21:14 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:17.072268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabec1a2-c693-499d-ae46-dc5d1d15614f None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:17.072841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabec1a2-c693-499d-ae46-dc5d1d15614f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:17.072841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabec1a2-c693-499d-ae46-dc5d1d15614f None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:17.074592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 679/1332] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:17.080755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e71a6-56bb-4589-897d-339fe82c3b3e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:17.081169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e71a6-56bb-4589-897d-339fe82c3b3e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:17.081316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e71a6-56bb-4589-897d-339fe82c3b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:17.098883 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-3a5e71a6-56bb-4589-897d-339fe82c3b3e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:17.100070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3a5e71a6-56bb-4589-897d-339fe82c3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:17.107692 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 654/1333] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:17.130918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabec1a2-c693-499d-ae46-dc5d1d15614f None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:17.143725 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabec1a2-c693-499d-ae46-dc5d1d15614f None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:17.149003 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa518bc7-c957-4b54-b802-acbbc972f230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:17.149827 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518bc7-c957-4b54-b802-acbbc972f230 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:17.150108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518bc7-c957-4b54-b802-acbbc972f230 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:17.150383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518bc7-c957-4b54-b802-acbbc972f230 admin admin] PATH_INFO: `/v3/projects/77afdeb59def454e98929fed403aa68f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:17.161184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa518bc7-c957-4b54-b802-acbbc972f230 admin admin] RBAC: Authorizing `identity:get_project(project_id=77afdeb59def454e98929fed403aa68f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:17.163270 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa518bc7-c957-4b54-b802-acbbc972f230 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:17.164914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 680/1334] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:21:17 2021] GET /identity/v3/projects/77afdeb59def454e98929fed403aa68f => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:17.171436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e71a6-56bb-4589-897d-339fe82c3b3e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:17.180261 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e71a6-56bb-4589-897d-339fe82c3b3e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:17.184683 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12135d4b-7f3e-4ad0-be87-fdc8f419d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:17.185310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12135d4b-7f3e-4ad0-be87-fdc8f419d7ba admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:17.185590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12135d4b-7f3e-4ad0-be87-fdc8f419d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:17.185862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12135d4b-7f3e-4ad0-be87-fdc8f419d7ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:17.186621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12135d4b-7f3e-4ad0-be87-fdc8f419d7ba admin admin] RBAC: Adding query filter params (scope.project.id=77afdeb59def454e98929fed403aa68f) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:21:17.186964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12135d4b-7f3e-4ad0-be87-fdc8f419d7ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:17.188765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12135d4b-7f3e-4ad0-be87-fdc8f419d7ba admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:17.193972 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 655/1335] 10.222.0.23 () {56 vars in 1232 bytes} [Wed Aug 25 01:21:17 2021] GET /identity/v3/role_assignments?scope.project.id=77afdeb59def454e98929fed403aa68f => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:17.200555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa518bc7-c957-4b54-b802-acbbc972f230 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:17.210585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa518bc7-c957-4b54-b802-acbbc972f230 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:17.215065 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd380c0-5a33-4a51-b123-ff7b1fd8e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:17.215909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd380c0-5a33-4a51-b123-ff7b1fd8e4ab admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:17.216193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd380c0-5a33-4a51-b123-ff7b1fd8e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:17.216472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd380c0-5a33-4a51-b123-ff7b1fd8e4ab admin admin] PATH_INFO: `/v3/users/cdfadc90954540a0a1b2baa3a5c971b1` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:17.229593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd380c0-5a33-4a51-b123-ff7b1fd8e4ab admin admin] RBAC: Authorizing `identity:get_user(user_id=cdfadc90954540a0a1b2baa3a5c971b1)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:17.231749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd380c0-5a33-4a51-b123-ff7b1fd8e4ab admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:17.233344 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 681/1336] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:21:17 2021] GET /identity/v3/users/cdfadc90954540a0a1b2baa3a5c971b1 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:19.363485 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f441-0d6e-4c6b-a036-faffbbe221ef None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:19.364025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f441-0d6e-4c6b-a036-faffbbe221ef None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:19.364120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f441-0d6e-4c6b-a036-faffbbe221ef None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:19.365838 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 656/1337] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:19.371916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09dfd8-5f24-43ff-ad23-bef931179bc2 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:19.372351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09dfd8-5f24-43ff-ad23-bef931179bc2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:19.372494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09dfd8-5f24-43ff-ad23-bef931179bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:19.390387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-af09dfd8-5f24-43ff-ad23-bef931179bc2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:19.391597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-af09dfd8-5f24-43ff-ad23-bef931179bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:19.399861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 682/1338] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:19.422353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5f441-0d6e-4c6b-a036-faffbbe221ef None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:19.434607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5f441-0d6e-4c6b-a036-faffbbe221ef None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:19.439120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb1ae-039a-4b5e-b815-f64c50a68fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:19.439959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb1ae-039a-4b5e-b815-f64c50a68fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:19.440245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb1ae-039a-4b5e-b815-f64c50a68fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:19.440524 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb1ae-039a-4b5e-b815-f64c50a68fe0 admin admin] PATH_INFO: `/v3/projects/7f55a86cd1a640d8be3448d061dcba59` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:19.451796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceb1ae-039a-4b5e-b815-f64c50a68fe0 admin admin] RBAC: Authorizing `identity:get_project(project_id=7f55a86cd1a640d8be3448d061dcba59)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:19.453847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceb1ae-039a-4b5e-b815-f64c50a68fe0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:19.455539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 657/1339] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:21:19 2021] GET /identity/v3/projects/7f55a86cd1a640d8be3448d061dcba59 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:21:19.462407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09dfd8-5f24-43ff-ad23-bef931179bc2 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:19.471205 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09dfd8-5f24-43ff-ad23-bef931179bc2 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:19.475683 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bc01e-0586-40c0-b107-e671cba4a649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:19.476314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bc01e-0586-40c0-b107-e671cba4a649 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:19.476597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bc01e-0586-40c0-b107-e671cba4a649 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:19.476870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bc01e-0586-40c0-b107-e671cba4a649 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:19.477620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bc01e-0586-40c0-b107-e671cba4a649 admin admin] RBAC: Adding query filter params (scope.project.id=7f55a86cd1a640d8be3448d061dcba59) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:21:19.477928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bc01e-0586-40c0-b107-e671cba4a649 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:19.479817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bc01e-0586-40c0-b107-e671cba4a649 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:19.485590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 683/1340] 10.222.0.23 () {56 vars in 1232 bytes} [Wed Aug 25 01:21:19 2021] GET /identity/v3/role_assignments?scope.project.id=7f55a86cd1a640d8be3448d061dcba59 => generated 877 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:19.491437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb1ae-039a-4b5e-b815-f64c50a68fe0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:19.501073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb1ae-039a-4b5e-b815-f64c50a68fe0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:19.505887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093483e9-b0c2-475a-9e06-dccee31c3192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:19.507253 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093483e9-b0c2-475a-9e06-dccee31c3192 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:19.507536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093483e9-b0c2-475a-9e06-dccee31c3192 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:19.507808 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093483e9-b0c2-475a-9e06-dccee31c3192 admin admin] PATH_INFO: `/v3/users/f1ee6a2a566f4aeb8fbdab9bb3ed1a3c` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:19.521323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093483e9-b0c2-475a-9e06-dccee31c3192 admin admin] RBAC: Authorizing `identity:get_user(user_id=f1ee6a2a566f4aeb8fbdab9bb3ed1a3c)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:19.524150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093483e9-b0c2-475a-9e06-dccee31c3192 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:19.525791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 658/1341] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:21:19 2021] GET /identity/v3/users/f1ee6a2a566f4aeb8fbdab9bb3ed1a3c => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:19.531952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bc01e-0586-40c0-b107-e671cba4a649 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:19.541590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bc01e-0586-40c0-b107-e671cba4a649 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:19.546119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e32e35-b3ac-47de-8581-44f827f11d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:19.547059 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32e35-b3ac-47de-8581-44f827f11d45 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:19.547341 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32e35-b3ac-47de-8581-44f827f11d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:19.547618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e32e35-b3ac-47de-8581-44f827f11d45 admin admin] PATH_INFO: `/v3/users/32e3478197724a1bb9e9884add518e12` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:19.560994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e32e35-b3ac-47de-8581-44f827f11d45 admin admin] RBAC: Authorizing `identity:get_user(user_id=32e3478197724a1bb9e9884add518e12)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:19.563328 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e32e35-b3ac-47de-8581-44f827f11d45 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:19.564880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 684/1342] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:21:19 2021] GET /identity/v3/users/32e3478197724a1bb9e9884add518e12 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:21.754434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b0f9-d482-45e3-af53-7dc99a614944 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:21.755030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b0f9-d482-45e3-af53-7dc99a614944 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:21.755030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b0f9-d482-45e3-af53-7dc99a614944 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:21.756832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 659/1343] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:21.763203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ca7f-6f09-4cbe-b9e7-3c4827da9033 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:21.763591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ca7f-6f09-4cbe-b9e7-3c4827da9033 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:21.763691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ca7f-6f09-4cbe-b9e7-3c4827da9033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:21.781432 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2082ca7f-6f09-4cbe-b9e7-3c4827da9033 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:21.782615 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2082ca7f-6f09-4cbe-b9e7-3c4827da9033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:21.790876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 685/1344] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:21.814042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b0f9-d482-45e3-af53-7dc99a614944 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:21.826048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b0f9-d482-45e3-af53-7dc99a614944 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:21.830515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f299a52-4856-4905-b866-5435003e700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:21.831378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f299a52-4856-4905-b866-5435003e700f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:21.831662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f299a52-4856-4905-b866-5435003e700f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:21.831938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f299a52-4856-4905-b866-5435003e700f admin admin] PATH_INFO: `/v3/projects/cc261b49906c4930a345503272d9b675` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:21.842887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f299a52-4856-4905-b866-5435003e700f admin admin] RBAC: Authorizing `identity:get_project(project_id=cc261b49906c4930a345503272d9b675)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:21.844950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f299a52-4856-4905-b866-5435003e700f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:21.846640 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 660/1345] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:21:21 2021] GET /identity/v3/projects/cc261b49906c4930a345503272d9b675 => generated 361 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:21:21.853719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082ca7f-6f09-4cbe-b9e7-3c4827da9033 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:21.862710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082ca7f-6f09-4cbe-b9e7-3c4827da9033 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:21.867351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe0579-97b2-4274-a745-0a324a25f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:21.867970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe0579-97b2-4274-a745-0a324a25f18e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:21.868255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe0579-97b2-4274-a745-0a324a25f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:21.868532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe0579-97b2-4274-a745-0a324a25f18e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:21.869296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe0579-97b2-4274-a745-0a324a25f18e admin admin] RBAC: Adding query filter params (scope.project.id=cc261b49906c4930a345503272d9b675) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:21:21.869604 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe0579-97b2-4274-a745-0a324a25f18e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:21.871464 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe0579-97b2-4274-a745-0a324a25f18e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:21.876720 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 686/1346] 10.222.0.23 () {56 vars in 1232 bytes} [Wed Aug 25 01:21:21 2021] GET /identity/v3/role_assignments?scope.project.id=cc261b49906c4930a345503272d9b675 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:21.882433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f299a52-4856-4905-b866-5435003e700f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:21.891975 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f299a52-4856-4905-b866-5435003e700f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:21.896414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd2241-024d-4766-a1e1-bbd57909ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:21.897734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd2241-024d-4766-a1e1-bbd57909ac0f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:21.898013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd2241-024d-4766-a1e1-bbd57909ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:21.898289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd2241-024d-4766-a1e1-bbd57909ac0f admin admin] PATH_INFO: `/v3/users/82c6f59a93ff4224b938f801a8ac88be` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:21.911083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd2241-024d-4766-a1e1-bbd57909ac0f admin admin] RBAC: Authorizing `identity:get_user(user_id=82c6f59a93ff4224b938f801a8ac88be)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:21.913802 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd2241-024d-4766-a1e1-bbd57909ac0f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:21.915391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 661/1347] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:21:21 2021] GET /identity/v3/users/82c6f59a93ff4224b938f801a8ac88be => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:24.047170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295f0d8-9ced-46bc-a07a-4fc2a3b9314f None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:24.047819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295f0d8-9ced-46bc-a07a-4fc2a3b9314f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:24.047819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295f0d8-9ced-46bc-a07a-4fc2a3b9314f None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:24.049494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 687/1348] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:24.055821 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad021-822e-4df2-a504-8d4c17ea99ca None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:24.056256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad021-822e-4df2-a504-8d4c17ea99ca None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:24.056356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad021-822e-4df2-a504-8d4c17ea99ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:24.073845 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-f24ad021-822e-4df2-a504-8d4c17ea99ca None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:24.075078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f24ad021-822e-4df2-a504-8d4c17ea99ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:24.082643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 662/1349] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:24.105625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295f0d8-9ced-46bc-a07a-4fc2a3b9314f None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:24.117988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295f0d8-9ced-46bc-a07a-4fc2a3b9314f None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:24.122360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea2a5-d3f6-414d-ad09-e7d544785703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:24.123211 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea2a5-d3f6-414d-ad09-e7d544785703 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:24.123490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea2a5-d3f6-414d-ad09-e7d544785703 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:24.123762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea2a5-d3f6-414d-ad09-e7d544785703 admin admin] PATH_INFO: `/v3/projects/da9f11a9f3614d1eb83a61ce4af23a43` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:24.134909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea2a5-d3f6-414d-ad09-e7d544785703 admin admin] RBAC: Authorizing `identity:get_project(project_id=da9f11a9f3614d1eb83a61ce4af23a43)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:24.136940 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea2a5-d3f6-414d-ad09-e7d544785703 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:24.138552 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 688/1350] 10.222.0.23 () {56 vars in 1208 bytes} [Wed Aug 25 01:21:24 2021] GET /identity/v3/projects/da9f11a9f3614d1eb83a61ce4af23a43 => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:24.144862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ad021-822e-4df2-a504-8d4c17ea99ca None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:24.153703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ad021-822e-4df2-a504-8d4c17ea99ca None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:24.158173 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f57ec-ade4-4fd5-a4b0-15fa6eaf3cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:24.158829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f57ec-ade4-4fd5-a4b0-15fa6eaf3cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:24.159109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f57ec-ade4-4fd5-a4b0-15fa6eaf3cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:24.159386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f57ec-ade4-4fd5-a4b0-15fa6eaf3cb4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:24.160144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f57ec-ade4-4fd5-a4b0-15fa6eaf3cb4 admin admin] RBAC: Adding query filter params (scope.project.id=da9f11a9f3614d1eb83a61ce4af23a43) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:21:24.160451 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f57ec-ade4-4fd5-a4b0-15fa6eaf3cb4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:24.162263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f57ec-ade4-4fd5-a4b0-15fa6eaf3cb4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:24.167672 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 663/1351] 10.222.0.23 () {56 vars in 1232 bytes} [Wed Aug 25 01:21:24 2021] GET /identity/v3/role_assignments?scope.project.id=da9f11a9f3614d1eb83a61ce4af23a43 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:24.173583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea2a5-d3f6-414d-ad09-e7d544785703 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:24.183626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea2a5-d3f6-414d-ad09-e7d544785703 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:24.188291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8eee91-6d25-4c38-9b09-c1e7d775f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:24.189154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eee91-6d25-4c38-9b09-c1e7d775f73d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:24.189436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eee91-6d25-4c38-9b09-c1e7d775f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:24.189708 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8eee91-6d25-4c38-9b09-c1e7d775f73d admin admin] PATH_INFO: `/v3/users/2e3f36f5b5f44a18a2db871888e03bd7` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:24.190884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8eee91-6d25-4c38-9b09-c1e7d775f73d admin admin] RBAC: Authorizing `identity:get_user(user_id=2e3f36f5b5f44a18a2db871888e03bd7)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:24.192992 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8eee91-6d25-4c38-9b09-c1e7d775f73d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:24.195180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 689/1352] 10.222.0.23 () {56 vars in 1199 bytes} [Wed Aug 25 01:21:24 2021] GET /identity/v3/users/2e3f36f5b5f44a18a2db871888e03bd7 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:21:29.325166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df326495-5a0c-4731-86b7-8138ff98f586 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:29.325727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df326495-5a0c-4731-86b7-8138ff98f586 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:29.325727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df326495-5a0c-4731-86b7-8138ff98f586 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:29.327546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 664/1353] 10.222.0.23 () {54 vars in 918 bytes} [Wed Aug 25 01:21:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:29.333415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d82f-1bf7-4da3-b87d-411c22ec5560 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:29.333843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d82f-1bf7-4da3-b87d-411c22ec5560 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:29.333948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d82f-1bf7-4da3-b87d-411c22ec5560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:29.352740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-9e41d82f-1bf7-4da3-b87d-411c22ec5560 None None] MFA Rules not processed for user `40b49222a8e4474bbe14019418ec8aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:29.353517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9e41d82f-1bf7-4da3-b87d-411c22ec5560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:29.361713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 690/1354] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Aug 25 01:21:29 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:29.376388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03917-9370-4f16-90a0-6c0d438e706d None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:29.376684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03917-9370-4f16-90a0-6c0d438e706d None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:29.376965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03917-9370-4f16-90a0-6c0d438e706d None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:29.378750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 665/1355] 10.222.0.23 () {54 vars in 918 bytes} [Wed Aug 25 01:21:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:29.384223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3b33-e6f9-424a-b991-261bcbafd73d None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:29.384516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3b33-e6f9-424a-b991-261bcbafd73d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:29.384801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3b33-e6f9-424a-b991-261bcbafd73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:29.402671 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a10d3b33-e6f9-424a-b991-261bcbafd73d None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:29.403889 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a10d3b33-e6f9-424a-b991-261bcbafd73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:29.413439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 691/1356] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Aug 25 01:21:29 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:32.210315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a12fa-8c54-4b0b-9611-c49485131000 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:32.210880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a12fa-8c54-4b0b-9611-c49485131000 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:32.210880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a12fa-8c54-4b0b-9611-c49485131000 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:32.212766 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 666/1357] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:32.218651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeb094-5d9a-45f6-9f7f-e390449ac902 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:32.219147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeb094-5d9a-45f6-9f7f-e390449ac902 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:32.219257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeb094-5d9a-45f6-9f7f-e390449ac902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:32.238334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-eadeb094-5d9a-45f6-9f7f-e390449ac902 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:32.239564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-eadeb094-5d9a-45f6-9f7f-e390449ac902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:32.248075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 692/1358] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:32.291921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a12fa-8c54-4b0b-9611-c49485131000 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:32.306277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a12fa-8c54-4b0b-9611-c49485131000 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:32.311775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80384b4b-ff25-4557-91ab-71f431bd2321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:32.312406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80384b4b-ff25-4557-91ab-71f431bd2321 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:32.312692 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80384b4b-ff25-4557-91ab-71f431bd2321 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:32.312970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80384b4b-ff25-4557-91ab-71f431bd2321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:32.320905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80384b4b-ff25-4557-91ab-71f431bd2321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:32.322464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80384b4b-ff25-4557-91ab-71f431bd2321 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:32.331603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 667/1359] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:33.731927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861ac9-a1ee-4747-b93b-bafda2395078 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:33.732522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861ac9-a1ee-4747-b93b-bafda2395078 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:33.732522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861ac9-a1ee-4747-b93b-bafda2395078 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:33.734215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 693/1360] 10.222.0.23 () {54 vars in 911 bytes} [Wed Aug 25 01:21:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:33.739751 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b819e-9d1b-497b-aec5-f2b545f17348 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:33.740177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b819e-9d1b-497b-aec5-f2b545f17348 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:33.740316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b819e-9d1b-497b-aec5-f2b545f17348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:33.758556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-7b2b819e-9d1b-497b-aec5-f2b545f17348 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:33.759773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7b2b819e-9d1b-497b-aec5-f2b545f17348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:33.767505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 668/1361] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 25 01:21:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:33.918201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e861ac9-a1ee-4747-b93b-bafda2395078 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:33.932760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e861ac9-a1ee-4747-b93b-bafda2395078 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:33.938025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c8ba-d19f-4a30-88b5-f05c64d541d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:33.938653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c8ba-d19f-4a30-88b5-f05c64d541d2 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:33.938976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c8ba-d19f-4a30-88b5-f05c64d541d2 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:33.939253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c8ba-d19f-4a30-88b5-f05c64d541d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:33.947583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8c8ba-d19f-4a30-88b5-f05c64d541d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:33.949139 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8c8ba-d19f-4a30-88b5-f05c64d541d2 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:33.958135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 694/1362] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:35.341770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c9929-59a7-4303-bae2-42cd12d1b053 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:35.342331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c9929-59a7-4303-bae2-42cd12d1b053 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:35.342331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c9929-59a7-4303-bae2-42cd12d1b053 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:35.344119 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 669/1363] 10.222.0.23 () {54 vars in 911 bytes} [Wed Aug 25 01:21:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:35.349483 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bb9f-7547-4305-887d-731cdaa468c5 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:35.350455 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bb9f-7547-4305-887d-731cdaa468c5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:35.350650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bb9f-7547-4305-887d-731cdaa468c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:35.367759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-5f34bb9f-7547-4305-887d-731cdaa468c5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:35.368946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5f34bb9f-7547-4305-887d-731cdaa468c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:35.376511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 695/1364] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 25 01:21:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:21:35.527932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c9929-59a7-4303-bae2-42cd12d1b053 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:35.542495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c9929-59a7-4303-bae2-42cd12d1b053 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:35.547789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d6bb2-b272-4ebb-93b7-f5a12272e669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:35.548414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6bb2-b272-4ebb-93b7-f5a12272e669 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:35.548719 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6bb2-b272-4ebb-93b7-f5a12272e669 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:35.548978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d6bb2-b272-4ebb-93b7-f5a12272e669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:35.556752 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d6bb2-b272-4ebb-93b7-f5a12272e669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:35.558307 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d6bb2-b272-4ebb-93b7-f5a12272e669 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:35.567317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 670/1365] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:36.932859 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b36add-aea2-4668-89bb-d8a0a3186180 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:36.933394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b36add-aea2-4668-89bb-d8a0a3186180 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:36.933394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b36add-aea2-4668-89bb-d8a0a3186180 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:36.935197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 696/1366] 10.222.0.23 () {54 vars in 911 bytes} [Wed Aug 25 01:21:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:36.940626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a0fa-806f-4ddf-9a6e-1f88777b9a96 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:36.941039 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a0fa-806f-4ddf-9a6e-1f88777b9a96 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:36.941171 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a0fa-806f-4ddf-9a6e-1f88777b9a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:36.958790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-7e39a0fa-806f-4ddf-9a6e-1f88777b9a96 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:36.959994 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7e39a0fa-806f-4ddf-9a6e-1f88777b9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:36.967661 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 671/1367] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 25 01:21:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:37.116481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b36add-aea2-4668-89bb-d8a0a3186180 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:37.130248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b36add-aea2-4668-89bb-d8a0a3186180 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:37.136414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4724c8-4a35-4ff8-849a-15d1dfe9df8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:37.137038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4724c8-4a35-4ff8-849a-15d1dfe9df8a service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:37.137322 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4724c8-4a35-4ff8-849a-15d1dfe9df8a service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:37.137597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4724c8-4a35-4ff8-849a-15d1dfe9df8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:37.145310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4724c8-4a35-4ff8-849a-15d1dfe9df8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:37.146904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4724c8-4a35-4ff8-849a-15d1dfe9df8a service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:37.155891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 697/1368] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:38.517861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2eff6-2152-4a8b-9342-68649a24b37b None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:38.518337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2eff6-2152-4a8b-9342-68649a24b37b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:38.518442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2eff6-2152-4a8b-9342-68649a24b37b None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:38.520274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 672/1369] 10.222.0.23 () {54 vars in 911 bytes} [Wed Aug 25 01:21:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:38.526334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c6d12-509a-425f-9328-432d396b0643 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:38.526784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c6d12-509a-425f-9328-432d396b0643 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:38.526919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c6d12-509a-425f-9328-432d396b0643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:38.544994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d97c6d12-509a-425f-9328-432d396b0643 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:38.546189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d97c6d12-509a-425f-9328-432d396b0643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:38.553867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 698/1370] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 25 01:21:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:38.705315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2eff6-2152-4a8b-9342-68649a24b37b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:38.719750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2eff6-2152-4a8b-9342-68649a24b37b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:38.724995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70fe8c-6443-47a1-a0a1-20dd101c4cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:38.725619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fe8c-6443-47a1-a0a1-20dd101c4cb1 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:38.725909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fe8c-6443-47a1-a0a1-20dd101c4cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:38.726180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fe8c-6443-47a1-a0a1-20dd101c4cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:38.733851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70fe8c-6443-47a1-a0a1-20dd101c4cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:38.735453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70fe8c-6443-47a1-a0a1-20dd101c4cb1 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:38.744329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 673/1371] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:40.063648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5042fbe-4676-481d-9e84-0a8e520749b9 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:40.064240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5042fbe-4676-481d-9e84-0a8e520749b9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:40.064240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5042fbe-4676-481d-9e84-0a8e520749b9 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:40.065942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 699/1372] 10.222.0.23 () {54 vars in 911 bytes} [Wed Aug 25 01:21:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:40.071378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5215fbd-fc30-4aec-a2e5-c03c152937a2 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:40.071830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5215fbd-fc30-4aec-a2e5-c03c152937a2 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:40.071938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5215fbd-fc30-4aec-a2e5-c03c152937a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:40.089600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a5215fbd-fc30-4aec-a2e5-c03c152937a2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:40.090828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a5215fbd-fc30-4aec-a2e5-c03c152937a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:40.098359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 674/1373] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 25 01:21:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:40.249734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5042fbe-4676-481d-9e84-0a8e520749b9 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:40.269959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5042fbe-4676-481d-9e84-0a8e520749b9 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:40.276078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649e1fc-14f3-4684-8b2f-6263e71af646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:40.276715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e1fc-14f3-4684-8b2f-6263e71af646 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:40.276994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e1fc-14f3-4684-8b2f-6263e71af646 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:40.277268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e1fc-14f3-4684-8b2f-6263e71af646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:40.285336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649e1fc-14f3-4684-8b2f-6263e71af646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:40.286974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649e1fc-14f3-4684-8b2f-6263e71af646 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:40.295994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 700/1374] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:41.631591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f74af7-1e13-4db7-8e74-7b47ebb37561 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:41.632143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f74af7-1e13-4db7-8e74-7b47ebb37561 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:41.632256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f74af7-1e13-4db7-8e74-7b47ebb37561 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:41.634201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 675/1375] 10.222.0.23 () {54 vars in 911 bytes} [Wed Aug 25 01:21:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:41.639587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe37a44-6bab-4873-9f8b-c791827df8ca None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:41.640018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe37a44-6bab-4873-9f8b-c791827df8ca None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:41.640149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe37a44-6bab-4873-9f8b-c791827df8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:41.657895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-1fe37a44-6bab-4873-9f8b-c791827df8ca None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:41.659123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1fe37a44-6bab-4873-9f8b-c791827df8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:41.667253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 701/1376] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 25 01:21:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:41.817116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f74af7-1e13-4db7-8e74-7b47ebb37561 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:41.831290 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f74af7-1e13-4db7-8e74-7b47ebb37561 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:41.837149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5b780-f053-4fae-966e-1e54eac6d340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:41.837767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5b780-f053-4fae-966e-1e54eac6d340 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:41.838048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5b780-f053-4fae-966e-1e54eac6d340 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:41.838318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5b780-f053-4fae-966e-1e54eac6d340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:41.846089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5b780-f053-4fae-966e-1e54eac6d340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:41.847671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5b780-f053-4fae-966e-1e54eac6d340 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:41.856592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 676/1377] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:43.157773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ad48e-c7b0-4e47-b30f-55eb6f2c5757 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:43.158368 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ad48e-c7b0-4e47-b30f-55eb6f2c5757 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:43.158368 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ad48e-c7b0-4e47-b30f-55eb6f2c5757 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:43.160090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 702/1378] 10.222.0.23 () {54 vars in 911 bytes} [Wed Aug 25 01:21:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:43.166002 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e547c-0a92-4fd3-b05c-b482159298d4 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:43.166390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e547c-0a92-4fd3-b05c-b482159298d4 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:43.166558 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e547c-0a92-4fd3-b05c-b482159298d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:43.184732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-535e547c-0a92-4fd3-b05c-b482159298d4 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:43.185910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-535e547c-0a92-4fd3-b05c-b482159298d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:43.193464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 677/1379] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 25 01:21:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:43.343668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ad48e-c7b0-4e47-b30f-55eb6f2c5757 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:43.358459 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ad48e-c7b0-4e47-b30f-55eb6f2c5757 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:43.364092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de72a6-2ca6-4a7e-b475-812a1cefc01b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:43.364722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de72a6-2ca6-4a7e-b475-812a1cefc01b service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:43.365643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de72a6-2ca6-4a7e-b475-812a1cefc01b service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:43.365927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de72a6-2ca6-4a7e-b475-812a1cefc01b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:43.373934 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de72a6-2ca6-4a7e-b475-812a1cefc01b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:43.375557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de72a6-2ca6-4a7e-b475-812a1cefc01b service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:43.384777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 703/1380] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:44.697340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb35594-ff0a-4dde-9399-50aff0800f80 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:44.697891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb35594-ff0a-4dde-9399-50aff0800f80 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:44.697891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb35594-ff0a-4dde-9399-50aff0800f80 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:44.699702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 678/1381] 10.222.0.23 () {54 vars in 911 bytes} [Wed Aug 25 01:21:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:44.705228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bff88-977b-486e-b4f7-6701c39dcc3b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:44.705640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bff88-977b-486e-b4f7-6701c39dcc3b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:44.705785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bff88-977b-486e-b4f7-6701c39dcc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:44.722974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a32bff88-977b-486e-b4f7-6701c39dcc3b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:44.724651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a32bff88-977b-486e-b4f7-6701c39dcc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:44.732159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 704/1382] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Aug 25 01:21:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:44.886002 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb35594-ff0a-4dde-9399-50aff0800f80 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:44.899737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb35594-ff0a-4dde-9399-50aff0800f80 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:44.904974 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925ad06-6353-4a13-ab46-c8f3886931ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:44.905600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ad06-6353-4a13-ab46-c8f3886931ae service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:44.905883 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ad06-6353-4a13-ab46-c8f3886931ae service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:44.906155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ad06-6353-4a13-ab46-c8f3886931ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:44.914383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925ad06-6353-4a13-ab46-c8f3886931ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:44.915973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925ad06-6353-4a13-ab46-c8f3886931ae service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:44.924953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 679/1383] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:46.959655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742670c-ea2b-4ee8-b475-27b3faa4f276 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:46.960220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742670c-ea2b-4ee8-b475-27b3faa4f276 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:46.960220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742670c-ea2b-4ee8-b475-27b3faa4f276 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:46.962001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 705/1384] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:46.967866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989bacf-9efd-4de7-a807-9ef5fdd0d9e0 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:46.968287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989bacf-9efd-4de7-a807-9ef5fdd0d9e0 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:46.968415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989bacf-9efd-4de7-a807-9ef5fdd0d9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:46.986342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-5989bacf-9efd-4de7-a807-9ef5fdd0d9e0 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:46.987677 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5989bacf-9efd-4de7-a807-9ef5fdd0d9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:46.995281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 680/1385] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:47.034886 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742670c-ea2b-4ee8-b475-27b3faa4f276 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:47.036563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1742670c-ea2b-4ee8-b475-27b3faa4f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:47.048982 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742670c-ea2b-4ee8-b475-27b3faa4f276 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:47.052482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d779786-72f8-450b-8772-7be28d7abe0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:47.053117 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779786-72f8-450b-8772-7be28d7abe0f service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:47.053403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779786-72f8-450b-8772-7be28d7abe0f service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:47.053680 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779786-72f8-450b-8772-7be28d7abe0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:47.062296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d779786-72f8-450b-8772-7be28d7abe0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:47.063743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d779786-72f8-450b-8772-7be28d7abe0f service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:47.073290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 706/1386] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:49.358424 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416ca4b-3e37-44e8-a56f-0245b06bc901 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:49.358982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416ca4b-3e37-44e8-a56f-0245b06bc901 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:49.359097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416ca4b-3e37-44e8-a56f-0245b06bc901 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:49.360819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 681/1387] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:49.366745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3b1a9-0dc0-48cc-95d8-a762c24e108c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:49.367131 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3b1a9-0dc0-48cc-95d8-a762c24e108c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:49.367307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3b1a9-0dc0-48cc-95d8-a762c24e108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:49.385147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8ad3b1a9-0dc0-48cc-95d8-a762c24e108c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:49.386330 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8ad3b1a9-0dc0-48cc-95d8-a762c24e108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:49.393932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 707/1388] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:49.432071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416ca4b-3e37-44e8-a56f-0245b06bc901 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:49.442233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416ca4b-3e37-44e8-a56f-0245b06bc901 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:49.446182 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0bddd-50da-4049-9ca8-6de686790b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:49.446842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0bddd-50da-4049-9ca8-6de686790b49 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:49.447124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0bddd-50da-4049-9ca8-6de686790b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:49.447394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0bddd-50da-4049-9ca8-6de686790b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:49.456019 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0bddd-50da-4049-9ca8-6de686790b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:49.457440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0bddd-50da-4049-9ca8-6de686790b49 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:49.467309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 682/1389] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:51.941276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e618c3-3f74-4e9a-9d6d-c37b9209b567 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:51.941849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e618c3-3f74-4e9a-9d6d-c37b9209b567 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:51.941849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e618c3-3f74-4e9a-9d6d-c37b9209b567 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:51.943608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 708/1390] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:51.949513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373a4ae-78b1-43d4-8b64-5eae8873906e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:51.949961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373a4ae-78b1-43d4-8b64-5eae8873906e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:51.950105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373a4ae-78b1-43d4-8b64-5eae8873906e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:51.967977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-2373a4ae-78b1-43d4-8b64-5eae8873906e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:51.969174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2373a4ae-78b1-43d4-8b64-5eae8873906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:51.977495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 683/1391] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:52.015516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e618c3-3f74-4e9a-9d6d-c37b9209b567 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:52.026356 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e618c3-3f74-4e9a-9d6d-c37b9209b567 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:52.029892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04709354-3908-4a52-8b06-40be051fbe7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:52.030518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709354-3908-4a52-8b06-40be051fbe7e service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:52.030845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709354-3908-4a52-8b06-40be051fbe7e service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:52.031129 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709354-3908-4a52-8b06-40be051fbe7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:52.040455 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04709354-3908-4a52-8b06-40be051fbe7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:52.041881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04709354-3908-4a52-8b06-40be051fbe7e service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:52.051134 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 709/1392] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:54.282898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a87c98-1c76-4f8c-9340-fc755757717f None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:54.283312 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a87c98-1c76-4f8c-9340-fc755757717f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:54.283463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a87c98-1c76-4f8c-9340-fc755757717f None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:54.285243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 684/1393] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:54.291629 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb3a0c-26f7-44c9-b2e2-75a69cb528f2 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:54.292115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb3a0c-26f7-44c9-b2e2-75a69cb528f2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:54.292255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb3a0c-26f7-44c9-b2e2-75a69cb528f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:54.309395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7bdb3a0c-26f7-44c9-b2e2-75a69cb528f2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:54.310564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7bdb3a0c-26f7-44c9-b2e2-75a69cb528f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:54.318078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 710/1394] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:54.361725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a87c98-1c76-4f8c-9340-fc755757717f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:54.372051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a87c98-1c76-4f8c-9340-fc755757717f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:54.375495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d44929-577c-4b9f-a4f0-ca6ca74e8045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:54.376117 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44929-577c-4b9f-a4f0-ca6ca74e8045 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:54.376394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44929-577c-4b9f-a4f0-ca6ca74e8045 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:54.376662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44929-577c-4b9f-a4f0-ca6ca74e8045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:54.385820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d44929-577c-4b9f-a4f0-ca6ca74e8045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:54.387271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d44929-577c-4b9f-a4f0-ca6ca74e8045 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:54.396271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 685/1395] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:21:56.564147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfeefa-e105-474a-abbe-281fbed49bb4 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:56.564716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfeefa-e105-474a-abbe-281fbed49bb4 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:56.564716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfeefa-e105-474a-abbe-281fbed49bb4 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:56.566379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 711/1396] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:56.572865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c90aa-6a0c-4d12-b211-93c2e6805aa1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:56.573328 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c90aa-6a0c-4d12-b211-93c2e6805aa1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:56.573431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c90aa-6a0c-4d12-b211-93c2e6805aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:56.590476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-ae9c90aa-6a0c-4d12-b211-93c2e6805aa1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:56.591687 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ae9c90aa-6a0c-4d12-b211-93c2e6805aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:56.599238 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 686/1397] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:56.637875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfeefa-e105-474a-abbe-281fbed49bb4 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:56.648671 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfeefa-e105-474a-abbe-281fbed49bb4 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:56.652371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ded260-8321-4f2b-a961-3cdf0dbdf642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:56.653002 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded260-8321-4f2b-a961-3cdf0dbdf642 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:56.653285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded260-8321-4f2b-a961-3cdf0dbdf642 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:56.653562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ded260-8321-4f2b-a961-3cdf0dbdf642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:56.662192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ded260-8321-4f2b-a961-3cdf0dbdf642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:56.664134 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ded260-8321-4f2b-a961-3cdf0dbdf642 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:56.673206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 712/1398] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:58.884530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca18e9-6af3-46dd-a9e9-9e076fef1611 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:58.885094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca18e9-6af3-46dd-a9e9-9e076fef1611 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:58.885094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca18e9-6af3-46dd-a9e9-9e076fef1611 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:58.886926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 687/1399] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:21:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:21:58.892802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd74f4d-a509-4100-bd8a-7099604b68f9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:58.893245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd74f4d-a509-4100-bd8a-7099604b68f9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:58.893389 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd74f4d-a509-4100-bd8a-7099604b68f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:58.910518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-4dd74f4d-a509-4100-bd8a-7099604b68f9 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:21:58.911740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4dd74f4d-a509-4100-bd8a-7099604b68f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:21:58.919851 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 713/1400] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:21:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:21:58.958573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca18e9-6af3-46dd-a9e9-9e076fef1611 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:21:58.969230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca18e9-6af3-46dd-a9e9-9e076fef1611 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:21:58.972772 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621c99-c16a-48e1-8d57-0db2bdf2f12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:21:58.973394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621c99-c16a-48e1-8d57-0db2bdf2f12a service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:21:58.973678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621c99-c16a-48e1-8d57-0db2bdf2f12a service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:21:58.973956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621c99-c16a-48e1-8d57-0db2bdf2f12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:21:58.983082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621c99-c16a-48e1-8d57-0db2bdf2f12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:21:58.984500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621c99-c16a-48e1-8d57-0db2bdf2f12a service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:21:58.994133 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 688/1401] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:21:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:22:01.139429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25fa2e-d2ac-4540-bade-3c31777377ee None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:01.139951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25fa2e-d2ac-4540-bade-3c31777377ee None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:01.139951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25fa2e-d2ac-4540-bade-3c31777377ee None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:01.141660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 714/1402] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:01.147325 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e02ec8-6eed-41df-9ae6-6fe11274ab01 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:01.147762 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e02ec8-6eed-41df-9ae6-6fe11274ab01 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:01.147911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e02ec8-6eed-41df-9ae6-6fe11274ab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:01.165520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-27e02ec8-6eed-41df-9ae6-6fe11274ab01 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:01.166727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-27e02ec8-6eed-41df-9ae6-6fe11274ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:01.174254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 689/1403] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:22:01.211894 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25fa2e-d2ac-4540-bade-3c31777377ee None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:01.222193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25fa2e-d2ac-4540-bade-3c31777377ee None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:01.225645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929df662-ca9c-4c7d-93ea-e4ea80de8730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:01.226786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929df662-ca9c-4c7d-93ea-e4ea80de8730 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:01.227068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929df662-ca9c-4c7d-93ea-e4ea80de8730 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:01.227341 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929df662-ca9c-4c7d-93ea-e4ea80de8730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:01.235887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929df662-ca9c-4c7d-93ea-e4ea80de8730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:01.237305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929df662-ca9c-4c7d-93ea-e4ea80de8730 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:01.246954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 715/1404] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:22:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:22:03.393193 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba54f3-b4c8-4fb3-a796-719aebdc8cb7 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:03.393764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba54f3-b4c8-4fb3-a796-719aebdc8cb7 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:03.393764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba54f3-b4c8-4fb3-a796-719aebdc8cb7 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:03.395529 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 690/1405] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:03.401311 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d754fd-12ba-4b4b-bb5a-6f739cfa06e0 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:03.401707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d754fd-12ba-4b4b-bb5a-6f739cfa06e0 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:03.401872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d754fd-12ba-4b4b-bb5a-6f739cfa06e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:03.419703 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-88d754fd-12ba-4b4b-bb5a-6f739cfa06e0 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:03.420899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-88d754fd-12ba-4b4b-bb5a-6f739cfa06e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:03.428538 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 716/1406] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:22:03.466893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba54f3-b4c8-4fb3-a796-719aebdc8cb7 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:03.477926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba54f3-b4c8-4fb3-a796-719aebdc8cb7 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:03.481572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29241265-60f7-4789-b572-b6799caa3bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:03.482246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241265-60f7-4789-b572-b6799caa3bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:03.482538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241265-60f7-4789-b572-b6799caa3bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:03.482966 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241265-60f7-4789-b572-b6799caa3bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:03.492688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29241265-60f7-4789-b572-b6799caa3bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:03.494150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29241265-60f7-4789-b572-b6799caa3bf9 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:03.503404 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 691/1407] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:22:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:22:05.643379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfa7fb-755f-41d6-8903-6d012ef7ba3c None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:05.643955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfa7fb-755f-41d6-8903-6d012ef7ba3c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:05.643955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfa7fb-755f-41d6-8903-6d012ef7ba3c None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:05.645700 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 717/1408] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:05.651553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458ec0-753e-47c5-bfc7-bf9093eac1f8 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:05.651993 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458ec0-753e-47c5-bfc7-bf9093eac1f8 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:05.652103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458ec0-753e-47c5-bfc7-bf9093eac1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:05.669722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-0a458ec0-753e-47c5-bfc7-bf9093eac1f8 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:05.670921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0a458ec0-753e-47c5-bfc7-bf9093eac1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:05.678355 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 692/1409] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:22:05.715383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfa7fb-755f-41d6-8903-6d012ef7ba3c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:05.725661 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfa7fb-755f-41d6-8903-6d012ef7ba3c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:05.729631 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d77078-bcd9-46af-8495-ac679a36068a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:05.730256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d77078-bcd9-46af-8495-ac679a36068a service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:05.730539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d77078-bcd9-46af-8495-ac679a36068a service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:05.730855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d77078-bcd9-46af-8495-ac679a36068a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:05.739445 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d77078-bcd9-46af-8495-ac679a36068a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:05.740852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d77078-bcd9-46af-8495-ac679a36068a service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:05.750686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 718/1410] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:22:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:22:07.881878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23485-36cf-4f7e-a47e-41590ecfdc14 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:07.882901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23485-36cf-4f7e-a47e-41590ecfdc14 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:07.882901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23485-36cf-4f7e-a47e-41590ecfdc14 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:07.884903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 693/1411] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:07.891019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892b0ad-8e77-47c9-9299-134c8584f109 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:07.891436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892b0ad-8e77-47c9-9299-134c8584f109 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:07.891585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892b0ad-8e77-47c9-9299-134c8584f109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:07.909529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7892b0ad-8e77-47c9-9299-134c8584f109 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:07.910735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7892b0ad-8e77-47c9-9299-134c8584f109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:07.918692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 719/1412] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:22:07.955689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db23485-36cf-4f7e-a47e-41590ecfdc14 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:07.966626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db23485-36cf-4f7e-a47e-41590ecfdc14 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:07.970135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd950ee-20b1-434e-8192-3a4780ad1e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:07.970782 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd950ee-20b1-434e-8192-3a4780ad1e6e service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:07.971061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd950ee-20b1-434e-8192-3a4780ad1e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:07.971336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd950ee-20b1-434e-8192-3a4780ad1e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:07.979870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd950ee-20b1-434e-8192-3a4780ad1e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:07.981269 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd950ee-20b1-434e-8192-3a4780ad1e6e service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:07.990337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 694/1413] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:22:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:22:24.325081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a62025-a802-4cba-920a-c9b088ebddfe None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:24.325599 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a62025-a802-4cba-920a-c9b088ebddfe None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:24.325699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a62025-a802-4cba-920a-c9b088ebddfe None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:24.327488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 720/1414] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:24.333229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927e411-b517-4346-8e12-628a9f420996 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:24.333679 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927e411-b517-4346-8e12-628a9f420996 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:24.333801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927e411-b517-4346-8e12-628a9f420996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:24.351048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c927e411-b517-4346-8e12-628a9f420996 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:24.352231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c927e411-b517-4346-8e12-628a9f420996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:24.359769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 695/1415] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:22:24.408240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e07a37-5c96-4cc3-b7a7-673e333d2b77 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:24.408534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e07a37-5c96-4cc3-b7a7-673e333d2b77 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:24.408818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e07a37-5c96-4cc3-b7a7-673e333d2b77 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:24.410545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 721/1416] 10.222.0.23 () {54 vars in 966 bytes} [Wed Aug 25 01:22:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:24.416128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dfc1b-4dce-4345-ab71-7a524bb4c1dc None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:24.416416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dfc1b-4dce-4345-ab71-7a524bb4c1dc None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:24.416694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dfc1b-4dce-4345-ab71-7a524bb4c1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:24.434660 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c11dfc1b-4dce-4345-ab71-7a524bb4c1dc None None] MFA Rules not processed for user `c0b9d35e26e64c959e075622321df3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:24.435865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c11dfc1b-4dce-4345-ab71-7a524bb4c1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:24.442049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 696/1417] 10.222.0.23 () {58 vars in 1064 bytes} [Wed Aug 25 01:22:24 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:22:24.449423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e07a37-5c96-4cc3-b7a7-673e333d2b77 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:24.459772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e07a37-5c96-4cc3-b7a7-673e333d2b77 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:24.463288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52c93c-e6b2-4b65-a199-cafac34a29e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b9d35e26e64c959e075622321df3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:24.463904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52c93c-e6b2-4b65-a199-cafac34a29e7 service glance] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:24.464190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52c93c-e6b2-4b65-a199-cafac34a29e7 service glance] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:24.464466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52c93c-e6b2-4b65-a199-cafac34a29e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:24.473749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52c93c-e6b2-4b65-a199-cafac34a29e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:24.475220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52c93c-e6b2-4b65-a199-cafac34a29e7 service glance] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:24.484946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 722/1418] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:22:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:22:26.688124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e7370-59e7-449d-97fc-495e350034bc None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:26.688789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e7370-59e7-449d-97fc-495e350034bc None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:26.688789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e7370-59e7-449d-97fc-495e350034bc None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:26.690447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 697/1419] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:26.696929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9965ddb-c04e-4669-ba81-846dd604902c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:26.697379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9965ddb-c04e-4669-ba81-846dd604902c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:26.697501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9965ddb-c04e-4669-ba81-846dd604902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:26.715332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d9965ddb-c04e-4669-ba81-846dd604902c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:26.716515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d9965ddb-c04e-4669-ba81-846dd604902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:26.724204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 723/1420] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:22:26.748327 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e7370-59e7-449d-97fc-495e350034bc None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:26.760988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e7370-59e7-449d-97fc-495e350034bc None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:26.765381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f018e-ea7c-40ae-b12a-9b8d4c1b5c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:26.766012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f018e-ea7c-40ae-b12a-9b8d4c1b5c56 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:26.766292 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f018e-ea7c-40ae-b12a-9b8d4c1b5c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:26.766565 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f018e-ea7c-40ae-b12a-9b8d4c1b5c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:26.767317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f018e-ea7c-40ae-b12a-9b8d4c1b5c56 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:26.769142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f018e-ea7c-40ae-b12a-9b8d4c1b5c56 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:26.783698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 698/1421] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Aug 25 01:22:26 2021] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:22:28.946633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348dbf-a3f7-44f6-9062-45dcba8bb48b None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:28.947259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348dbf-a3f7-44f6-9062-45dcba8bb48b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:28.947259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348dbf-a3f7-44f6-9062-45dcba8bb48b None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:28.948972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 724/1422] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:28.954832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30c70-9d1b-4ecf-94c9-351f77b5ffe5 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:28.955287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30c70-9d1b-4ecf-94c9-351f77b5ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:28.955391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30c70-9d1b-4ecf-94c9-351f77b5ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:28.972574 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-6de30c70-9d1b-4ecf-94c9-351f77b5ffe5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:28.973764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6de30c70-9d1b-4ecf-94c9-351f77b5ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:28.981884 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 699/1423] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:22:29.024627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348dbf-a3f7-44f6-9062-45dcba8bb48b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:29.038502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348dbf-a3f7-44f6-9062-45dcba8bb48b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:29.044423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f355443-1527-45d7-a48a-d08c22f46af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:29.045053 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f355443-1527-45d7-a48a-d08c22f46af1 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:29.045340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f355443-1527-45d7-a48a-d08c22f46af1 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:29.045621 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f355443-1527-45d7-a48a-d08c22f46af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:29.053486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f355443-1527-45d7-a48a-d08c22f46af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:29.055728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f355443-1527-45d7-a48a-d08c22f46af1 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:29.064788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 725/1424] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:22:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:22:31.369430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a0d50-a662-49b6-8066-09fcc84bd603 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:31.370002 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a0d50-a662-49b6-8066-09fcc84bd603 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:31.370002 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a0d50-a662-49b6-8066-09fcc84bd603 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:31.371805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 700/1425] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:31.377670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87d065-67dd-4f04-b4b0-aa981258fe43 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:31.378076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87d065-67dd-4f04-b4b0-aa981258fe43 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:31.378246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87d065-67dd-4f04-b4b0-aa981258fe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:31.397039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-ed87d065-67dd-4f04-b4b0-aa981258fe43 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:31.398920 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ed87d065-67dd-4f04-b4b0-aa981258fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:31.406658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 726/1426] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:22:31.442487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a0d50-a662-49b6-8066-09fcc84bd603 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:31.453250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a0d50-a662-49b6-8066-09fcc84bd603 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:31.456730 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5a314-0288-4541-869a-b42c3269a070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:31.457354 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a314-0288-4541-869a-b42c3269a070 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:31.457638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a314-0288-4541-869a-b42c3269a070 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:31.457910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a314-0288-4541-869a-b42c3269a070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:31.467422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5a314-0288-4541-869a-b42c3269a070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:31.468836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5a314-0288-4541-869a-b42c3269a070 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:31.477832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 701/1427] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:22:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:22:33.641167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1613f-f804-4be0-8028-48f17de48840 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:33.641730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1613f-f804-4be0-8028-48f17de48840 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:33.641829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1613f-f804-4be0-8028-48f17de48840 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:33.643665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 727/1428] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:33.649636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85cee0-82d0-45ac-b850-69578027cd8b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:33.650094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85cee0-82d0-45ac-b850-69578027cd8b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:33.650207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85cee0-82d0-45ac-b850-69578027cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:33.667722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-6c85cee0-82d0-45ac-b850-69578027cd8b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:33.668885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6c85cee0-82d0-45ac-b850-69578027cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:33.676342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 702/1429] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:22:33.715577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1613f-f804-4be0-8028-48f17de48840 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:33.725909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1613f-f804-4be0-8028-48f17de48840 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:33.729898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c81f0-f384-4501-9d19-c0071236c863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:33.730523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c81f0-f384-4501-9d19-c0071236c863 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:33.730847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c81f0-f384-4501-9d19-c0071236c863 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:33.731133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c81f0-f384-4501-9d19-c0071236c863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:33.739785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c81f0-f384-4501-9d19-c0071236c863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:33.741222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c81f0-f384-4501-9d19-c0071236c863 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:33.750973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 728/1430] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:22:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:22:36.025192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ae1d7-8546-483b-9670-83c124e1c444 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:36.025768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ae1d7-8546-483b-9670-83c124e1c444 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:36.025768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ae1d7-8546-483b-9670-83c124e1c444 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:36.027521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 703/1431] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:36.033259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f62ccb-f4b9-4244-9beb-db5ef587ff52 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:36.033691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f62ccb-f4b9-4244-9beb-db5ef587ff52 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:36.033813 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f62ccb-f4b9-4244-9beb-db5ef587ff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:36.051918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-04f62ccb-f4b9-4244-9beb-db5ef587ff52 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:36.053122 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-04f62ccb-f4b9-4244-9beb-db5ef587ff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:36.061358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 729/1432] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:22:36.109410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ae1d7-8546-483b-9670-83c124e1c444 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:36.120348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ae1d7-8546-483b-9670-83c124e1c444 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:36.123841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a3383-ce9d-4917-99ea-b47ddd65770f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:36.124470 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a3383-ce9d-4917-99ea-b47ddd65770f service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:36.124754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a3383-ce9d-4917-99ea-b47ddd65770f service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:36.125030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a3383-ce9d-4917-99ea-b47ddd65770f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:36.134361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a3383-ce9d-4917-99ea-b47ddd65770f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:36.136095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a3383-ce9d-4917-99ea-b47ddd65770f service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:36.145337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 704/1433] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:22:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:22:38.482561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b05081-d2b6-4bcc-9924-dbf6e4d486a0 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:38.483156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b05081-d2b6-4bcc-9924-dbf6e4d486a0 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:38.483156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b05081-d2b6-4bcc-9924-dbf6e4d486a0 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:38.484907 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 730/1434] 10.222.0.23 () {54 vars in 926 bytes} [Wed Aug 25 01:22:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:22:38.490861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603f467-e911-449a-92e8-e25666ef1d11 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:38.491296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603f467-e911-449a-92e8-e25666ef1d11 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:38.491419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603f467-e911-449a-92e8-e25666ef1d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:38.508647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-0603f467-e911-449a-92e8-e25666ef1d11 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:22:38.509833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0603f467-e911-449a-92e8-e25666ef1d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:22:38.517700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 705/1435] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Aug 25 01:22:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:22:38.557909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b05081-d2b6-4bcc-9924-dbf6e4d486a0 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:22:38.568287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b05081-d2b6-4bcc-9924-dbf6e4d486a0 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:22:38.571827 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027d087-56f9-4a2d-bfa5-23b78b9564dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:22:38.572455 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027d087-56f9-4a2d-bfa5-23b78b9564dd service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:22:38.572742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027d087-56f9-4a2d-bfa5-23b78b9564dd service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:22:38.573017 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027d087-56f9-4a2d-bfa5-23b78b9564dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:22:38.581561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027d087-56f9-4a2d-bfa5-23b78b9564dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:22:38.583019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027d087-56f9-4a2d-bfa5-23b78b9564dd service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:22:38.592565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 731/1436] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:22:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:23:51.129773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294e8e1-ddd4-4051-8ea8-cfa0f3c7e3f6 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.130382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294e8e1-ddd4-4051-8ea8-cfa0f3c7e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.130382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294e8e1-ddd4-4051-8ea8-cfa0f3c7e3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.149396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-f294e8e1-ddd4-4051-8ea8-cfa0f3c7e3f6 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:23:51.150589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f294e8e1-ddd4-4051-8ea8-cfa0f3c7e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:23:51.158591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 706/1437] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:23:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:23:51.166811 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efb430-980b-4c2a-87a3-f5b27ba2106b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.167292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efb430-980b-4c2a-87a3-f5b27ba2106b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.167388 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efb430-980b-4c2a-87a3-f5b27ba2106b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.189875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-59efb430-980b-4c2a-87a3-f5b27ba2106b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:23:51.191087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-59efb430-980b-4c2a-87a3-f5b27ba2106b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:23:51.198567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 732/1438] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:23:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:23:51.203300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294e8e1-ddd4-4051-8ea8-cfa0f3c7e3f6 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:23:51.212525 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294e8e1-ddd4-4051-8ea8-cfa0f3c7e3f6 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:23:51.216891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbac15a-8788-450d-8a42-ad77f7f7b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:23:51.217527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac15a-8788-450d-8a42-ad77f7f7b1da admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.217809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac15a-8788-450d-8a42-ad77f7f7b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.218082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac15a-8788-450d-8a42-ad77f7f7b1da admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.218829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbac15a-8788-450d-8a42-ad77f7f7b1da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:23:51.219137 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbac15a-8788-450d-8a42-ad77f7f7b1da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:23:51.220699 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbac15a-8788-450d-8a42-ad77f7f7b1da admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:23:51.232037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 707/1439] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:23:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:23:51.239629 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efb430-980b-4c2a-87a3-f5b27ba2106b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:23:51.248960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efb430-980b-4c2a-87a3-f5b27ba2106b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:23:51.253338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3b0c9-c6c8-494e-b9ec-40b19c848b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:23:51.253970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b0c9-c6c8-494e-b9ec-40b19c848b42 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.254248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b0c9-c6c8-494e-b9ec-40b19c848b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.254519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b0c9-c6c8-494e-b9ec-40b19c848b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.255222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3b0c9-c6c8-494e-b9ec-40b19c848b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:23:51.257091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3b0c9-c6c8-494e-b9ec-40b19c848b42 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:23:51.292738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 733/1440] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:23:51 2021] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:23:51.296835 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbac15a-8788-450d-8a42-ad77f7f7b1da admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:23:51.306888 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbac15a-8788-450d-8a42-ad77f7f7b1da admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:23:51.358995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c59c62-27fe-40ce-85c6-a36b0c4db6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:23:51.359659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59c62-27fe-40ce-85c6-a36b0c4db6fd admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.359945 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59c62-27fe-40ce-85c6-a36b0c4db6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.360220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59c62-27fe-40ce-85c6-a36b0c4db6fd admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.360912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c59c62-27fe-40ce-85c6-a36b0c4db6fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:23:51.362878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c59c62-27fe-40ce-85c6-a36b0c4db6fd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:23:51.383411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 708/1441] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:23:51 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:23:51.387738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3b0c9-c6c8-494e-b9ec-40b19c848b42 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:23:51.397624 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3b0c9-c6c8-494e-b9ec-40b19c848b42 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:23:51.402048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3064b1-b59c-451c-bb37-ecff11dbe9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:23:51.402727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3064b1-b59c-451c-bb37-ecff11dbe9ce admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.403015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3064b1-b59c-451c-bb37-ecff11dbe9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.403293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3064b1-b59c-451c-bb37-ecff11dbe9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.404007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3064b1-b59c-451c-bb37-ecff11dbe9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:23:51.405589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3064b1-b59c-451c-bb37-ecff11dbe9ce admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:23:51.418180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 734/1442] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:23:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:23:51.421893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c59c62-27fe-40ce-85c6-a36b0c4db6fd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:23:51.431965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c59c62-27fe-40ce-85c6-a36b0c4db6fd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:23:51.436551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acaaf2-9682-4094-9aab-968fd125bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:23:51.437189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acaaf2-9682-4094-9aab-968fd125bec7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.437465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acaaf2-9682-4094-9aab-968fd125bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.437736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acaaf2-9682-4094-9aab-968fd125bec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.438437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acaaf2-9682-4094-9aab-968fd125bec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:23:51.440042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acaaf2-9682-4094-9aab-968fd125bec7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:23:51.453361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 709/1443] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:23:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:23:51.457360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3064b1-b59c-451c-bb37-ecff11dbe9ce admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:23:51.467422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3064b1-b59c-451c-bb37-ecff11dbe9ce admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:23:51.472310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de9afc-7c66-4b16-812b-8b583646b9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:23:51.473180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de9afc-7c66-4b16-812b-8b583646b9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.473462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de9afc-7c66-4b16-812b-8b583646b9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.473742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de9afc-7c66-4b16-812b-8b583646b9d1 admin admin] PATH_INFO: `/v3/projects/9a9901a3e524470283d71cbbae2c4b35/users/c90b3de3c92443faa3f570f4646396ae/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.488510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de9afc-7c66-4b16-812b-8b583646b9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9901a3e524470283d71cbbae2c4b35, user_id=c90b3de3c92443faa3f570f4646396ae, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:23:51.491212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de9afc-7c66-4b16-812b-8b583646b9d1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:23:51.504288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 735/1444] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:23:51 2021] PUT /identity/v3/projects/9a9901a3e524470283d71cbbae2c4b35/users/c90b3de3c92443faa3f570f4646396ae/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:23:51.516931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ae9a-ca8c-4d06-9428-f844e10c6324 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.517222 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ae9a-ca8c-4d06-9428-f844e10c6324 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.517503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ae9a-ca8c-4d06-9428-f844e10c6324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.543178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-77e0ae9a-ca8c-4d06-9428-f844e10c6324 None None] MFA Rules not processed for user `c90b3de3c92443faa3f570f4646396ae`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:23:51.544364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-77e0ae9a-ca8c-4d06-9428-f844e10c6324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:23:51.604594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 710/1445] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:23:51 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:23:51.615815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de9afc-7c66-4b16-812b-8b583646b9d1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:23:51.683626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de9afc-7c66-4b16-812b-8b583646b9d1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:23:51.689047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bec7c5-2c0e-49c5-a4b2-2f192d3e4ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:23:51.689692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bec7c5-2c0e-49c5-a4b2-2f192d3e4ef5 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.689981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bec7c5-2c0e-49c5-a4b2-2f192d3e4ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.690262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bec7c5-2c0e-49c5-a4b2-2f192d3e4ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.698734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bec7c5-2c0e-49c5-a4b2-2f192d3e4ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:23:51.700329 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bec7c5-2c0e-49c5-a4b2-2f192d3e4ef5 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:23:51.709049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 736/1446] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:23:51 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:23:51.776431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808ded5-9652-4821-aa2c-7d238c8e37df None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.776720 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808ded5-9652-4821-aa2c-7d238c8e37df None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.777018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808ded5-9652-4821-aa2c-7d238c8e37df None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.778725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 711/1447] 10.222.0.23 () {52 vars in 829 bytes} [Wed Aug 25 01:23:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:23:51.782266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bec7c5-2c0e-49c5-a4b2-2f192d3e4ef5 service nova] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:23:51.842021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bec7c5-2c0e-49c5-a4b2-2f192d3e4ef5 service nova] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:23:51.846440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:23:51.847409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.847691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.847967 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] PATH_INFO: `/v3/users/c90b3de3c92443faa3f570f4646396ae` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.849117 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90b3de3c92443faa3f570f4646396ae)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:23:51.850121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:23:51.850121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:23:51.850121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:23:51.851841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:23:51.915367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90b3de3c92443faa3f570f4646396ae'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:23:51.934309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90b3de3c92443faa3f570f4646396ae'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:23:51.935027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90b3de3c92443faa3f570f4646396ae'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:23:51.946523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90b3de3c92443faa3f570f4646396ae'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:23:51.947194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90b3de3c92443faa3f570f4646396ae'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:23:51.961694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 737/1448] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:23:51 2021] DELETE /identity/v3/users/c90b3de3c92443faa3f570f4646396ae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:23:51.966142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a455f-9f69-4662-8777-a13c0b9cf71a None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:51.966437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a455f-9f69-4662-8777-a13c0b9cf71a None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:51.966753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a455f-9f69-4662-8777-a13c0b9cf71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:51.983979 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-148a455f-9f69-4662-8777-a13c0b9cf71a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:23:51.985167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-148a455f-9f69-4662-8777-a13c0b9cf71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:23:52.039619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 712/1449] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:23:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:23:52.049072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:23:52.050478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:23:52.106529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141355-28b7-445d-ad20-e420ad3f21f2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:23:52.110029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f141372-601d-4ba3-8626-3b840e435f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:23:52.110716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141372-601d-4ba3-8626-3b840e435f1c service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:52.111001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141372-601d-4ba3-8626-3b840e435f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:52.111270 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141372-601d-4ba3-8626-3b840e435f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:52.120418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f141372-601d-4ba3-8626-3b840e435f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:23:52.121847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f141372-601d-4ba3-8626-3b840e435f1c service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:23:52.130804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 738/1450] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:23:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:23:52.454442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a455f-9f69-4662-8777-a13c0b9cf71a None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:23:52.455907 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-148a455f-9f69-4662-8777-a13c0b9cf71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:23:52.467885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a455f-9f69-4662-8777-a13c0b9cf71a None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:23:52.472639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:23:52.473492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:23:52.473776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:23:52.474053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] PATH_INFO: `/v3/projects/9a9901a3e524470283d71cbbae2c4b35` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:23:52.475259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9901a3e524470283d71cbbae2c4b35)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:23:52.476931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:23:52.476931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:23:52.476931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:23:52.478121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:23:52.537754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9901a3e524470283d71cbbae2c4b35', 'request_id': 'req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:23:52.551118 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9901a3e524470283d71cbbae2c4b35', 'request_id': 'req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:23:52.556867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9901a3e524470283d71cbbae2c4b35', 'request_id': 'req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:23:52.571567 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] The token cache is being invalidate because project 9a9901a3e524470283d71cbbae2c4b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:23:52.571851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:23:52.572466 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3a8c74ce-0dac-4c20-ad30-2ba6854ac071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:23:52.574048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 713/1451] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:23:52 2021] DELETE /identity/v3/projects/9a9901a3e524470283d71cbbae2c4b35 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:25:14.537878 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19fd96-478b-44d5-8ec1-3f8c5f90b307 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:14.538393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19fd96-478b-44d5-8ec1-3f8c5f90b307 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:14.538504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19fd96-478b-44d5-8ec1-3f8c5f90b307 None None] PATH_INFO: `/v3` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:14.539757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 739/1452] 10.222.0.26 () {54 vars in 926 bytes} [Wed Aug 25 01:25:14 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:25:14.547303 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980cd4-74da-4834-99ad-ba5875a3f706 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:14.547743 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980cd4-74da-4834-99ad-ba5875a3f706 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:14.547898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980cd4-74da-4834-99ad-ba5875a3f706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:14.566192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-84980cd4-74da-4834-99ad-ba5875a3f706 None None] MFA Rules not processed for user `40b49222a8e4474bbe14019418ec8aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:14.566746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bf510-6a4f-4c71-b04d-0e4284ce4371 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:14.567041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bf510-6a4f-4c71-b04d-0e4284ce4371 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:14.567340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bf510-6a4f-4c71-b04d-0e4284ce4371 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:14.567690 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-84980cd4-74da-4834-99ad-ba5875a3f706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:14.569096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 25 01:25:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:25:14.574646 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe405b0-672e-463e-a4b1-dfdaf4636d7e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:14.574981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe405b0-672e-463e-a4b1-dfdaf4636d7e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:14.575265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe405b0-672e-463e-a4b1-dfdaf4636d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:14.593452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-ffe405b0-672e-463e-a4b1-dfdaf4636d7e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:14.594643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ffe405b0-672e-463e-a4b1-dfdaf4636d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:14.627871 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 714/1454] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Aug 25 01:25:14 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:25:14.651058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 741/1455] 127.0.0.1 () {58 vars in 999 bytes} [Wed Aug 25 01:25:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:25:14.805781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84980cd4-74da-4834-99ad-ba5875a3f706 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:25:14.807551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-84980cd4-74da-4834-99ad-ba5875a3f706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:14.880344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84980cd4-74da-4834-99ad-ba5875a3f706 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:25:14.886457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f03ca-a632-4a49-93f7-281c69a0ad14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:25:14.887125 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f03ca-a632-4a49-93f7-281c69a0ad14 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:14.887410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f03ca-a632-4a49-93f7-281c69a0ad14 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:14.887688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f03ca-a632-4a49-93f7-281c69a0ad14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:14.895833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f03ca-a632-4a49-93f7-281c69a0ad14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:25:14.897417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f03ca-a632-4a49-93f7-281c69a0ad14 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:25:14.906539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 715/1456] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:25:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:25:16.263869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932219-03fc-42ab-a340-07ec1e232841 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:16.264442 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932219-03fc-42ab-a340-07ec1e232841 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:16.264442 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932219-03fc-42ab-a340-07ec1e232841 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:16.266181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 742/1457] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 25 01:25:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:25:16.271420 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac70bf4-8614-436f-8b04-04b041c641f3 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:16.271836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac70bf4-8614-436f-8b04-04b041c641f3 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:16.271980 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac70bf4-8614-436f-8b04-04b041c641f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:16.289566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-8ac70bf4-8614-436f-8b04-04b041c641f3 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:16.290779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8ac70bf4-8614-436f-8b04-04b041c641f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:16.298283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 716/1458] 127.0.0.1 () {58 vars in 999 bytes} [Wed Aug 25 01:25:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:25:16.453471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9932219-03fc-42ab-a340-07ec1e232841 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:25:16.467697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9932219-03fc-42ab-a340-07ec1e232841 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:25:16.473167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce6f49-50e1-4103-aa50-470cc8807563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:25:16.473797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6f49-50e1-4103-aa50-470cc8807563 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:16.474082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6f49-50e1-4103-aa50-470cc8807563 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:16.474357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6f49-50e1-4103-aa50-470cc8807563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:16.482463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce6f49-50e1-4103-aa50-470cc8807563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:25:16.484104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce6f49-50e1-4103-aa50-470cc8807563 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:25:16.493979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 743/1459] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:25:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:25:18.306074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71656ba2-ee7a-46af-9b02-369d148b0980 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:18.306523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71656ba2-ee7a-46af-9b02-369d148b0980 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:18.306660 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71656ba2-ee7a-46af-9b02-369d148b0980 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:18.308502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 717/1460] 10.222.0.23 () {54 vars in 960 bytes} [Wed Aug 25 01:25:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:25:18.313871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44914706-6d93-4336-90e0-94b4474803df None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:18.314285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44914706-6d93-4336-90e0-94b4474803df None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:18.314424 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44914706-6d93-4336-90e0-94b4474803df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:18.331930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-44914706-6d93-4336-90e0-94b4474803df None None] MFA Rules not processed for user `40b49222a8e4474bbe14019418ec8aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:18.333092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-44914706-6d93-4336-90e0-94b4474803df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:18.341323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 744/1461] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Aug 25 01:25:18 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:25:18.349041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71656ba2-ee7a-46af-9b02-369d148b0980 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:25:18.362264 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71656ba2-ee7a-46af-9b02-369d148b0980 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:25:18.367725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ada7c1-db7e-4c17-bce2-d3c50fc01742 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b49222a8e4474bbe14019418ec8aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:25:18.368341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ada7c1-db7e-4c17-bce2-d3c50fc01742 service placement] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:18.368619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ada7c1-db7e-4c17-bce2-d3c50fc01742 service placement] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:18.368885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ada7c1-db7e-4c17-bce2-d3c50fc01742 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:18.376697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ada7c1-db7e-4c17-bce2-d3c50fc01742 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:25:18.378260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ada7c1-db7e-4c17-bce2-d3c50fc01742 service placement] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:25:18.387467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 718/1462] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:25:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:25:28.263841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9594d-48f7-4f12-8fd6-9e9beba3bb59 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:28.264452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9594d-48f7-4f12-8fd6-9e9beba3bb59 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:28.264452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9594d-48f7-4f12-8fd6-9e9beba3bb59 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:28.266154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 745/1463] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 25 01:25:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:25:28.271368 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1bd62-6741-4eb0-8387-9d7626cdf69f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:28.271847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1bd62-6741-4eb0-8387-9d7626cdf69f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:28.271963 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1bd62-6741-4eb0-8387-9d7626cdf69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:28.292174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d5a1bd62-6741-4eb0-8387-9d7626cdf69f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:28.293376 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d5a1bd62-6741-4eb0-8387-9d7626cdf69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:28.301163 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 719/1464] 127.0.0.1 () {58 vars in 999 bytes} [Wed Aug 25 01:25:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:25:28.453622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9594d-48f7-4f12-8fd6-9e9beba3bb59 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:25:28.468173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9594d-48f7-4f12-8fd6-9e9beba3bb59 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:25:28.473520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941242fa-bbaf-42fd-94d9-15f028cc2bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:25:28.474151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941242fa-bbaf-42fd-94d9-15f028cc2bd2 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:28.474438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941242fa-bbaf-42fd-94d9-15f028cc2bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:28.474748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941242fa-bbaf-42fd-94d9-15f028cc2bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:28.483343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941242fa-bbaf-42fd-94d9-15f028cc2bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:25:28.484930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941242fa-bbaf-42fd-94d9-15f028cc2bd2 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:25:28.494447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 746/1465] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:25:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:25:29.840616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96292-2ebf-4d21-80dc-a9d066a0b40b None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:29.841128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96292-2ebf-4d21-80dc-a9d066a0b40b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:29.841241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96292-2ebf-4d21-80dc-a9d066a0b40b None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:29.842995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 720/1466] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 25 01:25:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:25:29.848192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17adc17-ad4e-4394-bc90-50205494f6e6 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:29.848620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17adc17-ad4e-4394-bc90-50205494f6e6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:29.848760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17adc17-ad4e-4394-bc90-50205494f6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:29.866941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d17adc17-ad4e-4394-bc90-50205494f6e6 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:29.868354 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d17adc17-ad4e-4394-bc90-50205494f6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:29.875996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 747/1467] 127.0.0.1 () {58 vars in 999 bytes} [Wed Aug 25 01:25:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:25:30.027338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb96292-2ebf-4d21-80dc-a9d066a0b40b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:25:30.041912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb96292-2ebf-4d21-80dc-a9d066a0b40b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:25:30.047278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941ca2-28ad-410a-9dbd-b9d0bbeff317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:25:30.047827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941ca2-28ad-410a-9dbd-b9d0bbeff317 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:30.048109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941ca2-28ad-410a-9dbd-b9d0bbeff317 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:30.048382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941ca2-28ad-410a-9dbd-b9d0bbeff317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:30.056181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941ca2-28ad-410a-9dbd-b9d0bbeff317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:25:30.057734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941ca2-28ad-410a-9dbd-b9d0bbeff317 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:25:30.066834 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 721/1468] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:25:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:25:34.048672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642be71-d002-4338-a945-1941f0bf7acb None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:34.049257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642be71-d002-4338-a945-1941f0bf7acb None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:34.049257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642be71-d002-4338-a945-1941f0bf7acb None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:34.050995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 748/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 25 01:25:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:25:34.056720 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d269df3-d2c6-49d0-ac99-e848514456cf None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:34.057170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d269df3-d2c6-49d0-ac99-e848514456cf None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:34.057277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d269df3-d2c6-49d0-ac99-e848514456cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:34.075267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-0d269df3-d2c6-49d0-ac99-e848514456cf None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:34.076452 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0d269df3-d2c6-49d0-ac99-e848514456cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:34.084104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 722/1470] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 25 01:25:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:25:34.120625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642be71-d002-4338-a945-1941f0bf7acb None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:25:34.122252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8642be71-d002-4338-a945-1941f0bf7acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:34.177028 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642be71-d002-4338-a945-1941f0bf7acb None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:25:34.181113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde495c-5ae6-4736-bea1-a36c829facf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:25:34.181738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde495c-5ae6-4736-bea1-a36c829facf0 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:34.182019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde495c-5ae6-4736-bea1-a36c829facf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:34.182292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde495c-5ae6-4736-bea1-a36c829facf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:34.190877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde495c-5ae6-4736-bea1-a36c829facf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:25:34.192281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde495c-5ae6-4736-bea1-a36c829facf0 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:25:34.201312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 749/1471] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:25:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:25:36.294474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca07fa2-8122-45c2-b1d3-59a3873c7e77 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:36.295081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca07fa2-8122-45c2-b1d3-59a3873c7e77 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:36.295081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca07fa2-8122-45c2-b1d3-59a3873c7e77 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:36.297034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 723/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 25 01:25:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:25:36.302740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d433b-cfd4-42b3-b3a0-f55be2f9120a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:36.303194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d433b-cfd4-42b3-b3a0-f55be2f9120a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:36.303298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d433b-cfd4-42b3-b3a0-f55be2f9120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:36.321661 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-0f6d433b-cfd4-42b3-b3a0-f55be2f9120a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:36.322884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0f6d433b-cfd4-42b3-b3a0-f55be2f9120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:36.330742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 750/1473] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 25 01:25:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:25:36.368268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca07fa2-8122-45c2-b1d3-59a3873c7e77 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:25:36.369910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8ca07fa2-8122-45c2-b1d3-59a3873c7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:36.382494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca07fa2-8122-45c2-b1d3-59a3873c7e77 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:25:36.385912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b7a43-6d2d-4cf1-8093-62cbebb54b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:25:36.386539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b7a43-6d2d-4cf1-8093-62cbebb54b19 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:36.386855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b7a43-6d2d-4cf1-8093-62cbebb54b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:36.387130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b7a43-6d2d-4cf1-8093-62cbebb54b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:36.395811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b7a43-6d2d-4cf1-8093-62cbebb54b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:25:36.397201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b7a43-6d2d-4cf1-8093-62cbebb54b19 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:25:36.406225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 724/1474] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:25:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:25:40.041409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651be6d-8819-4836-bb17-d19d35e77e1b None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:40.041939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651be6d-8819-4836-bb17-d19d35e77e1b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:40.041939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651be6d-8819-4836-bb17-d19d35e77e1b None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:40.043741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 751/1475] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 25 01:25:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:25:40.049327 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac498d-9353-404d-8ab1-69c66adceb55 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:40.049739 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac498d-9353-404d-8ab1-69c66adceb55 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:40.049869 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac498d-9353-404d-8ab1-69c66adceb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:40.067925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-69ac498d-9353-404d-8ab1-69c66adceb55 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:40.069103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-69ac498d-9353-404d-8ab1-69c66adceb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:40.076880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 725/1476] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 25 01:25:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:25:40.130025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651be6d-8819-4836-bb17-d19d35e77e1b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:25:40.131722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4651be6d-8819-4836-bb17-d19d35e77e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:40.185649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651be6d-8819-4836-bb17-d19d35e77e1b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:25:40.189125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f8c02-1ba9-4d86-ad21-7399b05a50dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:25:40.189759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f8c02-1ba9-4d86-ad21-7399b05a50dd service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:40.190038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f8c02-1ba9-4d86-ad21-7399b05a50dd service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:40.190310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f8c02-1ba9-4d86-ad21-7399b05a50dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:40.198858 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f8c02-1ba9-4d86-ad21-7399b05a50dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:25:40.200266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f8c02-1ba9-4d86-ad21-7399b05a50dd service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:25:40.209211 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 752/1477] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:25:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:25:42.318991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0ff9-578a-4585-9a3d-8872c97fd584 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:42.320061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0ff9-578a-4585-9a3d-8872c97fd584 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:42.320061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0ff9-578a-4585-9a3d-8872c97fd584 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:42.321859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 726/1478] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 25 01:25:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:25:42.327339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb361252-11dc-4a38-9130-2525e49ea8de None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:42.327788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb361252-11dc-4a38-9130-2525e49ea8de None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:42.327920 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb361252-11dc-4a38-9130-2525e49ea8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:42.346035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-eb361252-11dc-4a38-9130-2525e49ea8de None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:42.347250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-eb361252-11dc-4a38-9130-2525e49ea8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:42.354819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 753/1479] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 25 01:25:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:25:42.408203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1213b-0e2e-4cc2-8fee-dccd55690c6c None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:42.408203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1213b-0e2e-4cc2-8fee-dccd55690c6c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:42.408438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1213b-0e2e-4cc2-8fee-dccd55690c6c None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:42.410045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 727/1480] 10.222.0.23 () {54 vars in 966 bytes} [Wed Aug 25 01:25:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:25:42.415323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e79fb1-41a2-4982-81d9-c5cd583fbb73 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:42.415610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e79fb1-41a2-4982-81d9-c5cd583fbb73 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:42.415889 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e79fb1-41a2-4982-81d9-c5cd583fbb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:42.433917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-37e79fb1-41a2-4982-81d9-c5cd583fbb73 None None] MFA Rules not processed for user `1dde8359945b45bbbf5d3a27964a7f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:25:42.435297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-37e79fb1-41a2-4982-81d9-c5cd583fbb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:25:42.441446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 754/1481] 10.222.0.23 () {58 vars in 1064 bytes} [Wed Aug 25 01:25:42 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:25:42.450065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1213b-0e2e-4cc2-8fee-dccd55690c6c None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:25:42.460141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1213b-0e2e-4cc2-8fee-dccd55690c6c None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:25:42.463553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3104-db0f-4376-8315-63b656696a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:25:42.464165 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3104-db0f-4376-8315-63b656696a9c service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:25:42.464444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3104-db0f-4376-8315-63b656696a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:25:42.464714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3104-db0f-4376-8315-63b656696a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:25:42.473165 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3104-db0f-4376-8315-63b656696a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:25:42.474556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3104-db0f-4376-8315-63b656696a9c service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:25:42.486352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 728/1482] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:25:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:01.610050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81510c4-c74e-40bc-8080-c0dacc31968e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:01.610658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81510c4-c74e-40bc-8080-c0dacc31968e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:01.610658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81510c4-c74e-40bc-8080-c0dacc31968e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:01.633319 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b81510c4-c74e-40bc-8080-c0dacc31968e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:01.634525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b81510c4-c74e-40bc-8080-c0dacc31968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:01.644978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 755/1483] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:01.653942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecb184-3e30-484c-9971-eb3c52792dff None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:01.654905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecb184-3e30-484c-9971-eb3c52792dff None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:01.655415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecb184-3e30-484c-9971-eb3c52792dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:01.678572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-0fecb184-3e30-484c-9971-eb3c52792dff None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:01.680179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0fecb184-3e30-484c-9971-eb3c52792dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:01.692217 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 729/1484] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:01.697227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81510c4-c74e-40bc-8080-c0dacc31968e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:01.711233 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81510c4-c74e-40bc-8080-c0dacc31968e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:01.716003 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171c8bc-0a9a-4156-b17f-9cadb46945d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:01.716674 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c8bc-0a9a-4156-b17f-9cadb46945d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:01.716957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c8bc-0a9a-4156-b17f-9cadb46945d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:01.717232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c8bc-0a9a-4156-b17f-9cadb46945d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:01.717953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171c8bc-0a9a-4156-b17f-9cadb46945d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:01.718255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171c8bc-0a9a-4156-b17f-9cadb46945d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:01.720043 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171c8bc-0a9a-4156-b17f-9cadb46945d9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:01.736929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 756/1485] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:01.745403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecb184-3e30-484c-9971-eb3c52792dff None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:01.757996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecb184-3e30-484c-9971-eb3c52792dff None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:01.766753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0247aea-2658-4afd-ad6c-9a9df653c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:01.767669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0247aea-2658-4afd-ad6c-9a9df653c0ae admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:01.768192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0247aea-2658-4afd-ad6c-9a9df653c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:01.768716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0247aea-2658-4afd-ad6c-9a9df653c0ae admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:01.769732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0247aea-2658-4afd-ad6c-9a9df653c0ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:01.772425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0247aea-2658-4afd-ad6c-9a9df653c0ae admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:01.811973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 730/1486] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:01 2021] POST /identity/v3/projects => generated 405 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:01.816345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171c8bc-0a9a-4156-b17f-9cadb46945d9 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:01.827605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171c8bc-0a9a-4156-b17f-9cadb46945d9 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:01.887248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2bac1-9566-4d47-a0d0-27661971b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:01.887921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2bac1-9566-4d47-a0d0-27661971b812 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:01.888202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2bac1-9566-4d47-a0d0-27661971b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:01.888477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2bac1-9566-4d47-a0d0-27661971b812 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:01.889420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2bac1-9566-4d47-a0d0-27661971b812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:01.891437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2bac1-9566-4d47-a0d0-27661971b812 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:01.919399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 757/1487] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:01 2021] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:01.923703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0247aea-2658-4afd-ad6c-9a9df653c0ae admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:01.939657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0247aea-2658-4afd-ad6c-9a9df653c0ae admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:01.948683 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920495b-53f4-4986-bb3d-4da35eaae1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:01.949649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920495b-53f4-4986-bb3d-4da35eaae1cd admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:01.950267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920495b-53f4-4986-bb3d-4da35eaae1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:01.950780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920495b-53f4-4986-bb3d-4da35eaae1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:01.951747 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920495b-53f4-4986-bb3d-4da35eaae1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:01.953558 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920495b-53f4-4986-bb3d-4da35eaae1cd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:01.969652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 731/1488] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:01 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:01.973564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2bac1-9566-4d47-a0d0-27661971b812 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:01.983849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2bac1-9566-4d47-a0d0-27661971b812 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:01.992249 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dab854-5ee7-49c9-8a29-156bf9f244e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:01.992918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab854-5ee7-49c9-8a29-156bf9f244e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:01.993197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab854-5ee7-49c9-8a29-156bf9f244e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:01.993472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab854-5ee7-49c9-8a29-156bf9f244e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:01.994190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dab854-5ee7-49c9-8a29-156bf9f244e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:01.995807 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dab854-5ee7-49c9-8a29-156bf9f244e6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.012064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 758/1489] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:01 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:02.012910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920495b-53f4-4986-bb3d-4da35eaae1cd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.024625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920495b-53f4-4986-bb3d-4da35eaae1cd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.033941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a3044-e02c-4a37-9f5c-39735b7da237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.035171 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a3044-e02c-4a37-9f5c-39735b7da237 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.035780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a3044-e02c-4a37-9f5c-39735b7da237 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.036291 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a3044-e02c-4a37-9f5c-39735b7da237 admin admin] PATH_INFO: `/v3/projects/aacc1af70b1448e5a35c36fc9497a5d3/users/76d5a616424f46b484561537feb81270/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.057878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a3044-e02c-4a37-9f5c-39735b7da237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacc1af70b1448e5a35c36fc9497a5d3, user_id=76d5a616424f46b484561537feb81270, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.061119 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a3044-e02c-4a37-9f5c-39735b7da237 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.089628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 732/1490] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:02 2021] PUT /identity/v3/projects/aacc1af70b1448e5a35c36fc9497a5d3/users/76d5a616424f46b484561537feb81270/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:02.095634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bef390-c484-41b3-b3db-0606f8fba977 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.095923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bef390-c484-41b3-b3db-0606f8fba977 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.096201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bef390-c484-41b3-b3db-0606f8fba977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.119958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-58bef390-c484-41b3-b3db-0606f8fba977 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.121184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-58bef390-c484-41b3-b3db-0606f8fba977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.128849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f302ee3-f90f-4a40-888d-bb86da5820ef None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.129424 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f302ee3-f90f-4a40-888d-bb86da5820ef None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.129942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f302ee3-f90f-4a40-888d-bb86da5820ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.179719 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-6f302ee3-f90f-4a40-888d-bb86da5820ef None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.181313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6f302ee3-f90f-4a40-888d-bb86da5820ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.228948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 759/1491] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.230333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb7d9a-35d1-408b-9c38-4d3b9dc80a2a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.230623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb7d9a-35d1-408b-9c38-4d3b9dc80a2a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.230928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb7d9a-35d1-408b-9c38-4d3b9dc80a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.254704 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-46bb7d9a-35d1-408b-9c38-4d3b9dc80a2a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.254704 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-46bb7d9a-35d1-408b-9c38-4d3b9dc80a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.266790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 760/1492] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.268142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e61d1-f8ee-4115-b440-3b68617064fa None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.268432 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e61d1-f8ee-4115-b440-3b68617064fa None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.268721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e61d1-f8ee-4115-b440-3b68617064fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.289844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-083e61d1-f8ee-4115-b440-3b68617064fa None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.294184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-083e61d1-f8ee-4115-b440-3b68617064fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.294609 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 733/1493] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.295592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f302ee3-f90f-4a40-888d-bb86da5820ef None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.306306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 761/1494] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.307762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df273f9-17ae-4707-8caf-9f19afb79e19 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.308180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df273f9-17ae-4707-8caf-9f19afb79e19 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.308353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df273f9-17ae-4707-8caf-9f19afb79e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.326279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-9df273f9-17ae-4707-8caf-9f19afb79e19 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.327490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9df273f9-17ae-4707-8caf-9f19afb79e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.335160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 762/1495] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.336351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14782301-9dc6-4e5f-8bea-2092bf1461e2 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.336639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14782301-9dc6-4e5f-8bea-2092bf1461e2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.336915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14782301-9dc6-4e5f-8bea-2092bf1461e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.352873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f302ee3-f90f-4a40-888d-bb86da5820ef None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.354345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-14782301-9dc6-4e5f-8bea-2092bf1461e2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.355530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-14782301-9dc6-4e5f-8bea-2092bf1461e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.356700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e6b1c-73bb-47eb-8d67-042a55f1e392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.357385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6b1c-73bb-47eb-8d67-042a55f1e392 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.357670 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6b1c-73bb-47eb-8d67-042a55f1e392 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.357948 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6b1c-73bb-47eb-8d67-042a55f1e392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.363083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 763/1496] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.365234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a596a-fc2a-43f5-af10-055cc258ec3e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.365740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a596a-fc2a-43f5-af10-055cc258ec3e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.366018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a596a-fc2a-43f5-af10-055cc258ec3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.367655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e6b1c-73bb-47eb-8d67-042a55f1e392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.369080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e6b1c-73bb-47eb-8d67-042a55f1e392 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.378577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 734/1497] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:02.379900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579ec3a-e00f-4729-a8f1-9acafc31e36f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.380232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579ec3a-e00f-4729-a8f1-9acafc31e36f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.380522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579ec3a-e00f-4729-a8f1-9acafc31e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.383124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-fa8a596a-fc2a-43f5-af10-055cc258ec3e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.384447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fa8a596a-fc2a-43f5-af10-055cc258ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.392994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 764/1498] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.396238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c839-ef67-46bf-a8f2-aa608840b5c6 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.396950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c839-ef67-46bf-a8f2-aa608840b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.397559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c839-ef67-46bf-a8f2-aa608840b5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.398298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-0579ec3a-e00f-4729-a8f1-9acafc31e36f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.399602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0579ec3a-e00f-4729-a8f1-9acafc31e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.407944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 735/1499] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.409081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3c5c-d924-419a-96a5-4e26796d0a3f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.409372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3c5c-d924-419a-96a5-4e26796d0a3f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.409712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3c5c-d924-419a-96a5-4e26796d0a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.418956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8966c839-ef67-46bf-a8f2-aa608840b5c6 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.420189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8966c839-ef67-46bf-a8f2-aa608840b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.428915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 765/1500] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.430033 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-90ed3c5c-d924-419a-96a5-4e26796d0a3f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.431250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-90ed3c5c-d924-419a-96a5-4e26796d0a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.433557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bc76d-ae53-4a14-9499-82357f4c20df None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.433853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bc76d-ae53-4a14-9499-82357f4c20df None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.434137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bc76d-ae53-4a14-9499-82357f4c20df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.439669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 736/1501] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.444210 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c98b-a239-45a6-865c-6f8825cccf69 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.444499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c98b-a239-45a6-865c-6f8825cccf69 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.444778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c98b-a239-45a6-865c-6f8825cccf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.457443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b11bc76d-ae53-4a14-9499-82357f4c20df None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.458749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b11bc76d-ae53-4a14-9499-82357f4c20df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.466961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-08e3c98b-a239-45a6-865c-6f8825cccf69 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.468576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-08e3c98b-a239-45a6-865c-6f8825cccf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.468808 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 766/1502] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.470322 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f57b6-6720-4551-8406-01f663716acc None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.470610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f57b6-6720-4551-8406-01f663716acc None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.470954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f57b6-6720-4551-8406-01f663716acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.483189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 737/1503] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.483189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8237123-2df6-4043-bc2f-7dd3e2c89224 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.483189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8237123-2df6-4043-bc2f-7dd3e2c89224 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.483189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8237123-2df6-4043-bc2f-7dd3e2c89224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.493648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-3b2f57b6-6720-4551-8406-01f663716acc None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.495114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3b2f57b6-6720-4551-8406-01f663716acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.504672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 767/1504] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.505710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f57b6-6720-4551-8406-01f663716acc None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.516040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f57b6-6720-4551-8406-01f663716acc None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.516542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-f8237123-2df6-4043-bc2f-7dd3e2c89224 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.517798 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f8237123-2df6-4043-bc2f-7dd3e2c89224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.521498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f48ff3-2509-48b6-9f59-f02e95674cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.522312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f48ff3-2509-48b6-9f59-f02e95674cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.523128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f48ff3-2509-48b6-9f59-f02e95674cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.523128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f48ff3-2509-48b6-9f59-f02e95674cd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.523683 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f48ff3-2509-48b6-9f59-f02e95674cd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:02.523996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f48ff3-2509-48b6-9f59-f02e95674cd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.526307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f48ff3-2509-48b6-9f59-f02e95674cd2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.530738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 738/1505] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.531387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8237123-2df6-4043-bc2f-7dd3e2c89224 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.540133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 768/1506] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:02.540133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14956-2801-4d79-972a-844fafcf7f1f None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.540528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14956-2801-4d79-972a-844fafcf7f1f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.540750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14956-2801-4d79-972a-844fafcf7f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.544208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8237123-2df6-4043-bc2f-7dd3e2c89224 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.551714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393db802-b135-4297-8218-f982956f71b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.552940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393db802-b135-4297-8218-f982956f71b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.553298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393db802-b135-4297-8218-f982956f71b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.553495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393db802-b135-4297-8218-f982956f71b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.554273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393db802-b135-4297-8218-f982956f71b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:02.554624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393db802-b135-4297-8218-f982956f71b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.556796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393db802-b135-4297-8218-f982956f71b5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.562531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-43b14956-2801-4d79-972a-844fafcf7f1f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:02.564156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-43b14956-2801-4d79-972a-844fafcf7f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:02.576190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 739/1507] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:02.576190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393db802-b135-4297-8218-f982956f71b5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.579382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 769/1508] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:02.580284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b14956-2801-4d79-972a-844fafcf7f1f None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.590178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b14956-2801-4d79-972a-844fafcf7f1f None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.590959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393db802-b135-4297-8218-f982956f71b5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.595226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7b31d-061a-4cae-b2bf-dda3353c8ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.596005 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7b31d-061a-4cae-b2bf-dda3353c8ceb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.596922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7b31d-061a-4cae-b2bf-dda3353c8ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.597068 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104d253-0503-4a23-bbb5-0b996f12dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.597175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7b31d-061a-4cae-b2bf-dda3353c8ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.597278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104d253-0503-4a23-bbb5-0b996f12dd11 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.597965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104d253-0503-4a23-bbb5-0b996f12dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.598082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7b31d-061a-4cae-b2bf-dda3353c8ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:02.598169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104d253-0503-4a23-bbb5-0b996f12dd11 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.598252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7b31d-061a-4cae-b2bf-dda3353c8ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.598612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104d253-0503-4a23-bbb5-0b996f12dd11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:02.599520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104d253-0503-4a23-bbb5-0b996f12dd11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.600439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7b31d-061a-4cae-b2bf-dda3353c8ceb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.601291 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104d253-0503-4a23-bbb5-0b996f12dd11 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.613203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 770/1509] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:02.613825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 740/1510] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:02.615973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7b31d-061a-4cae-b2bf-dda3353c8ceb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.616964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104d253-0503-4a23-bbb5-0b996f12dd11 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.628292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7b31d-061a-4cae-b2bf-dda3353c8ceb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.633950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104d253-0503-4a23-bbb5-0b996f12dd11 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.634999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429847d4-70c2-4d38-948f-31b9d7de3c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.635677 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429847d4-70c2-4d38-948f-31b9d7de3c52 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.635963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429847d4-70c2-4d38-948f-31b9d7de3c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.636299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429847d4-70c2-4d38-948f-31b9d7de3c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.637025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429847d4-70c2-4d38-948f-31b9d7de3c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:02.637336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429847d4-70c2-4d38-948f-31b9d7de3c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.639476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429847d4-70c2-4d38-948f-31b9d7de3c52 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.639748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036de973-8528-4750-a11c-72dbfc15e58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.640382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036de973-8528-4750-a11c-72dbfc15e58a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.640662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036de973-8528-4750-a11c-72dbfc15e58a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.641073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036de973-8528-4750-a11c-72dbfc15e58a admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.641656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036de973-8528-4750-a11c-72dbfc15e58a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:02.642283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036de973-8528-4750-a11c-72dbfc15e58a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.643677 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036de973-8528-4750-a11c-72dbfc15e58a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.660765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 771/1511] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:02.660765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429847d4-70c2-4d38-948f-31b9d7de3c52 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.661032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 741/1512] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:02.661032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036de973-8528-4750-a11c-72dbfc15e58a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.671385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036de973-8528-4750-a11c-72dbfc15e58a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.673981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429847d4-70c2-4d38-948f-31b9d7de3c52 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.676143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d97a3-d6b3-465f-83c6-79036dea0494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.677570 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d97a3-d6b3-465f-83c6-79036dea0494 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.678020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d97a3-d6b3-465f-83c6-79036dea0494 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.678294 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d97a3-d6b3-465f-83c6-79036dea0494 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.679162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d97a3-d6b3-465f-83c6-79036dea0494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.679975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5115570-55a0-4b2b-aa0a-fdbc216fb7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.680616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5115570-55a0-4b2b-aa0a-fdbc216fb7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.680900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5115570-55a0-4b2b-aa0a-fdbc216fb7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.681057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d97a3-d6b3-465f-83c6-79036dea0494 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.681182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5115570-55a0-4b2b-aa0a-fdbc216fb7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.681904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5115570-55a0-4b2b-aa0a-fdbc216fb7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.683950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5115570-55a0-4b2b-aa0a-fdbc216fb7d8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.711712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 742/1513] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:02.711712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d97a3-d6b3-465f-83c6-79036dea0494 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.725882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 772/1514] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:02.726818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5115570-55a0-4b2b-aa0a-fdbc216fb7d8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.794089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d97a3-d6b3-465f-83c6-79036dea0494 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.811900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5115570-55a0-4b2b-aa0a-fdbc216fb7d8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.818461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75fb12-3d51-4749-b379-127ddeec1c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.819289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75fb12-3d51-4749-b379-127ddeec1c88 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.819978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75fb12-3d51-4749-b379-127ddeec1c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.819978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75fb12-3d51-4749-b379-127ddeec1c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.820518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75fb12-3d51-4749-b379-127ddeec1c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.824056 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75fb12-3d51-4749-b379-127ddeec1c88 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.854365 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b56ff1-0b4f-47d4-9d66-030c74a1b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.855222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 773/1515] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:02.855363 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b56ff1-0b4f-47d4-9d66-030c74a1b519 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.855997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75fb12-3d51-4749-b379-127ddeec1c88 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.858433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b56ff1-0b4f-47d4-9d66-030c74a1b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.858776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b56ff1-0b4f-47d4-9d66-030c74a1b519 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.859511 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b56ff1-0b4f-47d4-9d66-030c74a1b519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:02.859824 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b56ff1-0b4f-47d4-9d66-030c74a1b519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.861445 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b56ff1-0b4f-47d4-9d66-030c74a1b519 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.873251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 743/1516] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:02.874013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b56ff1-0b4f-47d4-9d66-030c74a1b519 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.884685 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b56ff1-0b4f-47d4-9d66-030c74a1b519 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.925212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75fb12-3d51-4749-b379-127ddeec1c88 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:02.931231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed6cf4-b31f-49df-8d78-3719fd0e1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.931934 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed6cf4-b31f-49df-8d78-3719fd0e1b9c admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.932220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed6cf4-b31f-49df-8d78-3719fd0e1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.932498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed6cf4-b31f-49df-8d78-3719fd0e1b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.933215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed6cf4-b31f-49df-8d78-3719fd0e1b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.935154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed6cf4-b31f-49df-8d78-3719fd0e1b9c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.946771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3184e-d7c9-427b-8810-38b513e46b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:02.947691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3184e-d7c9-427b-8810-38b513e46b8c admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:02.948178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3184e-d7c9-427b-8810-38b513e46b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:02.948682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3184e-d7c9-427b-8810-38b513e46b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:02.949565 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3184e-d7c9-427b-8810-38b513e46b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:02.951721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3184e-d7c9-427b-8810-38b513e46b8c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:02.961227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 774/1517] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:02.961227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed6cf4-b31f-49df-8d78-3719fd0e1b9c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:02.980161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 744/1518] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:02.981014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3184e-d7c9-427b-8810-38b513e46b8c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.036083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed6cf4-b31f-49df-8d78-3719fd0e1b9c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.041611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d54e1-c53b-4634-ba93-410508c59faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.042008 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3184e-d7c9-427b-8810-38b513e46b8c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.042287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d54e1-c53b-4634-ba93-410508c59faf admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.042583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d54e1-c53b-4634-ba93-410508c59faf admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.042932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d54e1-c53b-4634-ba93-410508c59faf admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.043616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d54e1-c53b-4634-ba93-410508c59faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.045549 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d54e1-c53b-4634-ba93-410508c59faf admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.046994 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25069106-cb3c-47b3-adc4-f946292df118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.047652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25069106-cb3c-47b3-adc4-f946292df118 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.047933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25069106-cb3c-47b3-adc4-f946292df118 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.048205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25069106-cb3c-47b3-adc4-f946292df118 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.048882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25069106-cb3c-47b3-adc4-f946292df118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.050781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25069106-cb3c-47b3-adc4-f946292df118 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.072692 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 745/1519] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.073583 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25069106-cb3c-47b3-adc4-f946292df118 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.077616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 775/1520] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:02 2021] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.079435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d54e1-c53b-4634-ba93-410508c59faf admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.092245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25069106-cb3c-47b3-adc4-f946292df118 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.143714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d54e1-c53b-4634-ba93-410508c59faf admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.149013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adb7d4-c12d-4813-861d-55e831287f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.149850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adb7d4-c12d-4813-861d-55e831287f6c admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.150131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adb7d4-c12d-4813-861d-55e831287f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.150457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adb7d4-c12d-4813-861d-55e831287f6c admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.151102 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adb7d4-c12d-4813-861d-55e831287f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.153026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adb7d4-c12d-4813-861d-55e831287f6c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.153354 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dc242-a710-4061-a663-810dcf4cd323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.154035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc242-a710-4061-a663-810dcf4cd323 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.154326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc242-a710-4061-a663-810dcf4cd323 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.154608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc242-a710-4061-a663-810dcf4cd323 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.155323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dc242-a710-4061-a663-810dcf4cd323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.157284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dc242-a710-4061-a663-810dcf4cd323 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.177417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 746/1521] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.178202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adb7d4-c12d-4813-861d-55e831287f6c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.191756 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 776/1522] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.193242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dc242-a710-4061-a663-810dcf4cd323 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.195429 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adb7d4-c12d-4813-861d-55e831287f6c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.200106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a718416-8560-47b3-bcee-6ab9329e7929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.200760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a718416-8560-47b3-bcee-6ab9329e7929 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.201046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a718416-8560-47b3-bcee-6ab9329e7929 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.201324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a718416-8560-47b3-bcee-6ab9329e7929 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.202011 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a718416-8560-47b3-bcee-6ab9329e7929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.203941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a718416-8560-47b3-bcee-6ab9329e7929 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.204152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dc242-a710-4061-a663-810dcf4cd323 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.209509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc608a2-1b11-4e93-a321-fa765ac26d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.210153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc608a2-1b11-4e93-a321-fa765ac26d97 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.210434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc608a2-1b11-4e93-a321-fa765ac26d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.210763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc608a2-1b11-4e93-a321-fa765ac26d97 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.211399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc608a2-1b11-4e93-a321-fa765ac26d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.213310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc608a2-1b11-4e93-a321-fa765ac26d97 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.235260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 747/1523] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.235260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a718416-8560-47b3-bcee-6ab9329e7929 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.235589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 777/1524] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.235589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc608a2-1b11-4e93-a321-fa765ac26d97 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.246014 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc608a2-1b11-4e93-a321-fa765ac26d97 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.300846 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a718416-8560-47b3-bcee-6ab9329e7929 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.304871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566c51d-2e31-44a8-9315-ff0534f8648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.305550 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566c51d-2e31-44a8-9315-ff0534f8648a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.305839 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566c51d-2e31-44a8-9315-ff0534f8648a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.306119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566c51d-2e31-44a8-9315-ff0534f8648a admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.306700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab2e4-543d-4d14-a0a9-b7dfa9af2a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.306889 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566c51d-2e31-44a8-9315-ff0534f8648a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.307988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab2e4-543d-4d14-a0a9-b7dfa9af2a3c admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.308343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab2e4-543d-4d14-a0a9-b7dfa9af2a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.308512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566c51d-2e31-44a8-9315-ff0534f8648a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.309385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab2e4-543d-4d14-a0a9-b7dfa9af2a3c admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.310092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab2e4-543d-4d14-a0a9-b7dfa9af2a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.312108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab2e4-543d-4d14-a0a9-b7dfa9af2a3c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.321890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 778/1525] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.321890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566c51d-2e31-44a8-9315-ff0534f8648a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.332291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566c51d-2e31-44a8-9315-ff0534f8648a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.336896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 748/1526] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.336896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab2e4-543d-4d14-a0a9-b7dfa9af2a3c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.341971 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ea85c-0ad1-4598-904f-7c2ab155a501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.342879 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea85c-0ad1-4598-904f-7c2ab155a501 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.343266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea85c-0ad1-4598-904f-7c2ab155a501 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.343580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea85c-0ad1-4598-904f-7c2ab155a501 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.344342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ea85c-0ad1-4598-904f-7c2ab155a501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.345324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab2e4-543d-4d14-a0a9-b7dfa9af2a3c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.346435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ea85c-0ad1-4598-904f-7c2ab155a501 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.351668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f71a18-b778-40d1-b650-f632f3632502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.352331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f71a18-b778-40d1-b650-f632f3632502 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.352757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f71a18-b778-40d1-b650-f632f3632502 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.353200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f71a18-b778-40d1-b650-f632f3632502 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.354124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f71a18-b778-40d1-b650-f632f3632502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.356439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f71a18-b778-40d1-b650-f632f3632502 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.367628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 749/1527] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.369438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d701-e741-4c17-ab51-45d01581a81d None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.370036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d701-e741-4c17-ab51-45d01581a81d None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.370546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d701-e741-4c17-ab51-45d01581a81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.375499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 779/1528] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/users => generated 288 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.376721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ea85c-0ad1-4598-904f-7c2ab155a501 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.393764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ea85c-0ad1-4598-904f-7c2ab155a501 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.398822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-e908d701-e741-4c17-ab51-45d01581a81d None None] MFA Rules not processed for user `76d5a616424f46b484561537feb81270`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:03.399978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e908d701-e741-4c17-ab51-45d01581a81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:03.402363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bbe79-cec3-430e-9839-fcdc3a77bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.403573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbe79-cec3-430e-9839-fcdc3a77bfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.404098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbe79-cec3-430e-9839-fcdc3a77bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.404610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbe79-cec3-430e-9839-fcdc3a77bfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.405993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bbe79-cec3-430e-9839-fcdc3a77bfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.409134 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bbe79-cec3-430e-9839-fcdc3a77bfa8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.432956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 780/1529] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.432956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bbe79-cec3-430e-9839-fcdc3a77bfa8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.448935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bbe79-cec3-430e-9839-fcdc3a77bfa8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.454024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447637-48ae-404f-aab4-266f0fcbf389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.454743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447637-48ae-404f-aab4-266f0fcbf389 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.455027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447637-48ae-404f-aab4-266f0fcbf389 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.455307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447637-48ae-404f-aab4-266f0fcbf389 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.456022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5447637-48ae-404f-aab4-266f0fcbf389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.457634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5447637-48ae-404f-aab4-266f0fcbf389 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.464111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 750/1530] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:03.464992 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d701-e741-4c17-ab51-45d01581a81d None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.470609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 781/1531] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.471391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447637-48ae-404f-aab4-266f0fcbf389 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.475343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d701-e741-4c17-ab51-45d01581a81d None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.479847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267c84-fad7-4c1a-ac91-ae8693a69baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.480489 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267c84-fad7-4c1a-ac91-ae8693a69baf admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.480765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267c84-fad7-4c1a-ac91-ae8693a69baf admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.481042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267c84-fad7-4c1a-ac91-ae8693a69baf admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.481719 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7267c84-fad7-4c1a-ac91-ae8693a69baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.482260 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447637-48ae-404f-aab4-266f0fcbf389 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.483650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7267c84-fad7-4c1a-ac91-ae8693a69baf admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.491497 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd83e5b-74b3-4ad9-b651-ab0a7ffa5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.492165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd83e5b-74b3-4ad9-b651-ab0a7ffa5610 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.492450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd83e5b-74b3-4ad9-b651-ab0a7ffa5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.492732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd83e5b-74b3-4ad9-b651-ab0a7ffa5610 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.493450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd83e5b-74b3-4ad9-b651-ab0a7ffa5610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.495097 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd83e5b-74b3-4ad9-b651-ab0a7ffa5610 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.510042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 751/1532] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/users => generated 290 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.510042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267c84-fad7-4c1a-ac91-ae8693a69baf admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.510470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 782/1533] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.510470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd83e5b-74b3-4ad9-b651-ab0a7ffa5610 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.520366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267c84-fad7-4c1a-ac91-ae8693a69baf admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.522957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd83e5b-74b3-4ad9-b651-ab0a7ffa5610 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.525257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971fd33-cf20-4475-8347-6a8438f9fde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.526023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971fd33-cf20-4475-8347-6a8438f9fde0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.526263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971fd33-cf20-4475-8347-6a8438f9fde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.526551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971fd33-cf20-4475-8347-6a8438f9fde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.527319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971fd33-cf20-4475-8347-6a8438f9fde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.527557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed534b-20f2-4068-aabd-339449016d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.528203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed534b-20f2-4068-aabd-339449016d04 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.528489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed534b-20f2-4068-aabd-339449016d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.528770 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed534b-20f2-4068-aabd-339449016d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.528914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971fd33-cf20-4475-8347-6a8438f9fde0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.529477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed534b-20f2-4068-aabd-339449016d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.531093 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed534b-20f2-4068-aabd-339449016d04 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.538839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 752/1534] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.539637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971fd33-cf20-4475-8347-6a8438f9fde0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.542368 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 783/1535] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.542368 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed534b-20f2-4068-aabd-339449016d04 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.549460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971fd33-cf20-4475-8347-6a8438f9fde0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.553384 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed534b-20f2-4068-aabd-339449016d04 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.554831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579aeaf-e8b7-4e5c-b896-a45ece1746b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.555492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579aeaf-e8b7-4e5c-b896-a45ece1746b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.555861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579aeaf-e8b7-4e5c-b896-a45ece1746b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.556145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579aeaf-e8b7-4e5c-b896-a45ece1746b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.557017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579aeaf-e8b7-4e5c-b896-a45ece1746b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.558400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691f14a-7631-4f19-9e2c-2e166e47263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.558603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579aeaf-e8b7-4e5c-b896-a45ece1746b0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.559091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691f14a-7631-4f19-9e2c-2e166e47263d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.559378 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691f14a-7631-4f19-9e2c-2e166e47263d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.559662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691f14a-7631-4f19-9e2c-2e166e47263d admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.560620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691f14a-7631-4f19-9e2c-2e166e47263d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.562485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691f14a-7631-4f19-9e2c-2e166e47263d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.570687 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 753/1536] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.573200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579aeaf-e8b7-4e5c-b896-a45ece1746b0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.573926 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 784/1537] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.574842 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691f14a-7631-4f19-9e2c-2e166e47263d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.583269 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579aeaf-e8b7-4e5c-b896-a45ece1746b0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.584159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691f14a-7631-4f19-9e2c-2e166e47263d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.588015 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a861db-80d9-429c-9772-5559708ad14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.588656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a861db-80d9-429c-9772-5559708ad14a admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.588802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef0580-e614-4992-b513-7958fd6020a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.588939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a861db-80d9-429c-9772-5559708ad14a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.589206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a861db-80d9-429c-9772-5559708ad14a admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.589410 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef0580-e614-4992-b513-7958fd6020a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.589684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef0580-e614-4992-b513-7958fd6020a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.589885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a861db-80d9-429c-9772-5559708ad14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.589996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef0580-e614-4992-b513-7958fd6020a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.590646 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef0580-e614-4992-b513-7958fd6020a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.591886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a861db-80d9-429c-9772-5559708ad14a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.592228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef0580-e614-4992-b513-7958fd6020a2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.601901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 785/1538] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.602730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef0580-e614-4992-b513-7958fd6020a2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.611899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef0580-e614-4992-b513-7958fd6020a2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.617135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032eb9-3a25-4953-82c0-5f20cdd4fdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.617734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032eb9-3a25-4953-82c0-5f20cdd4fdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.617963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032eb9-3a25-4953-82c0-5f20cdd4fdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.618236 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032eb9-3a25-4953-82c0-5f20cdd4fdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.618649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 754/1539] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.619049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a032eb9-3a25-4953-82c0-5f20cdd4fdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.620682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a032eb9-3a25-4953-82c0-5f20cdd4fdc7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.622507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a861db-80d9-429c-9772-5559708ad14a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.631953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 786/1540] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.632917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032eb9-3a25-4953-82c0-5f20cdd4fdc7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.642798 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032eb9-3a25-4953-82c0-5f20cdd4fdc7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.685434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a861db-80d9-429c-9772-5559708ad14a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.690304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b09c9-3b37-4894-b27d-ba038439eb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.691232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b09c9-3b37-4894-b27d-ba038439eb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.691513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b09c9-3b37-4894-b27d-ba038439eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.691785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b09c9-3b37-4894-b27d-ba038439eb4b admin admin] PATH_INFO: `/v3/projects/46fe21ec575f40a0b26f9482a77b5a73/users/d2f7490ad6cf4bed96cfec8a39a65b43/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.700853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437392e-3010-4fc7-9ebf-65206596a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.701519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437392e-3010-4fc7-9ebf-65206596a7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.701806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437392e-3010-4fc7-9ebf-65206596a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.702084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437392e-3010-4fc7-9ebf-65206596a7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.702832 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437392e-3010-4fc7-9ebf-65206596a7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.704469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437392e-3010-4fc7-9ebf-65206596a7e8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.706076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b09c9-3b37-4894-b27d-ba038439eb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe21ec575f40a0b26f9482a77b5a73, user_id=d2f7490ad6cf4bed96cfec8a39a65b43, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.708849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b09c9-3b37-4894-b27d-ba038439eb4b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.714127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 787/1541] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.714908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437392e-3010-4fc7-9ebf-65206596a7e8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.722494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 755/1542] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:03 2021] PUT /identity/v3/projects/46fe21ec575f40a0b26f9482a77b5a73/users/d2f7490ad6cf4bed96cfec8a39a65b43/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:03.723342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b09c9-3b37-4894-b27d-ba038439eb4b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.724480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437392e-3010-4fc7-9ebf-65206596a7e8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.780116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf9057-056e-4b89-9d0f-cb87907ee437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.781111 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf9057-056e-4b89-9d0f-cb87907ee437 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.781395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf9057-056e-4b89-9d0f-cb87907ee437 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.781676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf9057-056e-4b89-9d0f-cb87907ee437 admin admin] PATH_INFO: `/v3/projects/b76ebd48c69044859010968bacfba90b/users/e85a2de1c4214589916a2ef12655c5b4/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.783632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b09c9-3b37-4894-b27d-ba038439eb4b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.788344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cddb80-2a00-4bca-8bd1-550ed37584c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.789032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cddb80-2a00-4bca-8bd1-550ed37584c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.789316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cddb80-2a00-4bca-8bd1-550ed37584c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.789598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cddb80-2a00-4bca-8bd1-550ed37584c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.790319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cddb80-2a00-4bca-8bd1-550ed37584c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.792025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cddb80-2a00-4bca-8bd1-550ed37584c3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.795184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf9057-056e-4b89-9d0f-cb87907ee437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76ebd48c69044859010968bacfba90b, user_id=e85a2de1c4214589916a2ef12655c5b4, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.797822 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf9057-056e-4b89-9d0f-cb87907ee437 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.801581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 756/1543] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.803239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cddb80-2a00-4bca-8bd1-550ed37584c3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.813938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cddb80-2a00-4bca-8bd1-550ed37584c3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.816120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 788/1544] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:03 2021] PUT /identity/v3/projects/b76ebd48c69044859010968bacfba90b/users/e85a2de1c4214589916a2ef12655c5b4/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:03.816906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf9057-056e-4b89-9d0f-cb87907ee437 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.871437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe25df8-ee52-40fb-9247-e95d49092976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.872344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe25df8-ee52-40fb-9247-e95d49092976 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.872629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe25df8-ee52-40fb-9247-e95d49092976 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.872906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe25df8-ee52-40fb-9247-e95d49092976 admin admin] PATH_INFO: `/v3/projects/3a2cd2d9105c4b869f11980f87585b4b/users/9c89701fb97d428285b06f967e77e835/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.875563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf9057-056e-4b89-9d0f-cb87907ee437 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.880322 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fba61-0189-4fab-b844-cc3a0d325eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.881269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fba61-0189-4fab-b844-cc3a0d325eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.881551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fba61-0189-4fab-b844-cc3a0d325eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.881825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fba61-0189-4fab-b844-cc3a0d325eaf admin admin] PATH_INFO: `/v3/projects/9332813e5ed544a58621b5d1c5e0bbba/users/ae3376227e8648fb9d2e46875db4b998/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.887063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe25df8-ee52-40fb-9247-e95d49092976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2cd2d9105c4b869f11980f87585b4b, user_id=9c89701fb97d428285b06f967e77e835, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.890223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe25df8-ee52-40fb-9247-e95d49092976 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.898194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fba61-0189-4fab-b844-cc3a0d325eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9332813e5ed544a58621b5d1c5e0bbba, user_id=ae3376227e8648fb9d2e46875db4b998, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.900988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fba61-0189-4fab-b844-cc3a0d325eaf admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.905460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 757/1545] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:03 2021] PUT /identity/v3/projects/3a2cd2d9105c4b869f11980f87585b4b/users/9c89701fb97d428285b06f967e77e835/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:03.907474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe25df8-ee52-40fb-9247-e95d49092976 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.915473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 789/1546] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:03 2021] PUT /identity/v3/projects/9332813e5ed544a58621b5d1c5e0bbba/users/ae3376227e8648fb9d2e46875db4b998/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:03.916389 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fba61-0189-4fab-b844-cc3a0d325eaf admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.967115 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe25df8-ee52-40fb-9247-e95d49092976 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.971740 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec081fd-3e83-4c0e-b2ac-5446ada4281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.972402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec081fd-3e83-4c0e-b2ac-5446ada4281f admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.972688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec081fd-3e83-4c0e-b2ac-5446ada4281f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.972975 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec081fd-3e83-4c0e-b2ac-5446ada4281f admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.973655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec081fd-3e83-4c0e-b2ac-5446ada4281f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.975720 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fba61-0189-4fab-b844-cc3a0d325eaf admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:03.976080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec081fd-3e83-4c0e-b2ac-5446ada4281f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.980393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b32e3-b344-45a1-95d0-1c7cb9c713a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:03.981201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b32e3-b344-45a1-95d0-1c7cb9c713a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.981486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b32e3-b344-45a1-95d0-1c7cb9c713a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.981762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b32e3-b344-45a1-95d0-1c7cb9c713a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:03.982479 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b32e3-b344-45a1-95d0-1c7cb9c713a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:03.984111 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b32e3-b344-45a1-95d0-1c7cb9c713a7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:03.994727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 758/1547] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/users => generated 309 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:03.997930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 790/1548] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:03.998077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec081fd-3e83-4c0e-b2ac-5446ada4281f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:03.998178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221b213-1322-4b09-bfc6-9908675558d7 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:03.998178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221b213-1322-4b09-bfc6-9908675558d7 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:03.998178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221b213-1322-4b09-bfc6-9908675558d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.005032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec081fd-3e83-4c0e-b2ac-5446ada4281f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.009493 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eea58-42b7-48d8-b9e9-ed12a23aa8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.010352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eea58-42b7-48d8-b9e9-ed12a23aa8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.010635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eea58-42b7-48d8-b9e9-ed12a23aa8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.010990 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eea58-42b7-48d8-b9e9-ed12a23aa8e0 admin admin] PATH_INFO: `/v3/projects/d7d56f9b7b7c467da9e0b8e72a57dc30/users/0a7b6aabfe654e57a4a0e3bed579a886/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.013299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7221b213-1322-4b09-bfc6-9908675558d7 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:04.014777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7221b213-1322-4b09-bfc6-9908675558d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:04.022312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 791/1549] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:04.023091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221b213-1322-4b09-bfc6-9908675558d7 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.025650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eea58-42b7-48d8-b9e9-ed12a23aa8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d56f9b7b7c467da9e0b8e72a57dc30, user_id=0a7b6aabfe654e57a4a0e3bed579a886, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.028549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eea58-42b7-48d8-b9e9-ed12a23aa8e0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.032060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221b213-1322-4b09-bfc6-9908675558d7 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.038225 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a57ad-f8ce-4828-818f-1e6a8ef8dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.039149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a57ad-f8ce-4828-818f-1e6a8ef8dcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.039419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a57ad-f8ce-4828-818f-1e6a8ef8dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.039695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a57ad-f8ce-4828-818f-1e6a8ef8dcf7 admin admin] PATH_INFO: `/v3/projects/1d6c251cf7e54d38a28b5fa64fd24173/users/1ac2381138f64f1f93f65adcb313fb37/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.043694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 759/1550] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:03 2021] PUT /identity/v3/projects/d7d56f9b7b7c467da9e0b8e72a57dc30/users/0a7b6aabfe654e57a4a0e3bed579a886/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:04.045020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610785-84a0-443d-83cc-11bb75e3b083 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.045313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610785-84a0-443d-83cc-11bb75e3b083 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.045589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8610785-84a0-443d-83cc-11bb75e3b083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.054397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a57ad-f8ce-4828-818f-1e6a8ef8dcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6c251cf7e54d38a28b5fa64fd24173, user_id=1ac2381138f64f1f93f65adcb313fb37, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.057384 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a57ad-f8ce-4828-818f-1e6a8ef8dcf7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.070361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d8610785-84a0-443d-83cc-11bb75e3b083 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:04.071506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d8610785-84a0-443d-83cc-11bb75e3b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:04.074976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 792/1551] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:04 2021] PUT /identity/v3/projects/1d6c251cf7e54d38a28b5fa64fd24173/users/1ac2381138f64f1f93f65adcb313fb37/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:04.076454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978be26-e51d-4ebb-8766-c5aa0718f632 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.076748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978be26-e51d-4ebb-8766-c5aa0718f632 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.077028 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978be26-e51d-4ebb-8766-c5aa0718f632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.102465 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c978be26-e51d-4ebb-8766-c5aa0718f632 None None] MFA Rules not processed for user `9c89701fb97d428285b06f967e77e835`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:04.103745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c978be26-e51d-4ebb-8766-c5aa0718f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:04.136170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 760/1552] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:04.137756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be253-e761-4ba7-8439-b7c92177244f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.138048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be253-e761-4ba7-8439-b7c92177244f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.138328 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be253-e761-4ba7-8439-b7c92177244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.155398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a71be253-e761-4ba7-8439-b7c92177244f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:04.156597 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a71be253-e761-4ba7-8439-b7c92177244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:04.164576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 761/1553] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:04.165336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71be253-e761-4ba7-8439-b7c92177244f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.168654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 793/1554] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:04 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:04.169472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978be26-e51d-4ebb-8766-c5aa0718f632 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.176518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71be253-e761-4ba7-8439-b7c92177244f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.180798 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978be26-e51d-4ebb-8766-c5aa0718f632 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.182052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340c24-f1ae-4cc9-b874-e5632d7fd40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.182745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340c24-f1ae-4cc9-b874-e5632d7fd40e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.183054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340c24-f1ae-4cc9-b874-e5632d7fd40e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.183332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340c24-f1ae-4cc9-b874-e5632d7fd40e admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.184084 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16340c24-f1ae-4cc9-b874-e5632d7fd40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.185485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9132cd-8fef-4228-81e2-9e73a53cfd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.185733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16340c24-f1ae-4cc9-b874-e5632d7fd40e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.186363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9132cd-8fef-4228-81e2-9e73a53cfd9d admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.186647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9132cd-8fef-4228-81e2-9e73a53cfd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.186958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9132cd-8fef-4228-81e2-9e73a53cfd9d admin admin] PATH_INFO: `/v3/projects/98f8fae0130241e28471150fe11feb81/users/9e9bbddb949d4a47a4fbd00b9d914521/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.195987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 762/1555] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:04.196787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340c24-f1ae-4cc9-b874-e5632d7fd40e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.201276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9132cd-8fef-4228-81e2-9e73a53cfd9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f8fae0130241e28471150fe11feb81, user_id=9e9bbddb949d4a47a4fbd00b9d914521, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.204071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9132cd-8fef-4228-81e2-9e73a53cfd9d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.217656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 794/1556] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:04 2021] PUT /identity/v3/projects/98f8fae0130241e28471150fe11feb81/users/9e9bbddb949d4a47a4fbd00b9d914521/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:04.218941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c0e3-150a-4214-a625-2b30c2575237 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.219234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c0e3-150a-4214-a625-2b30c2575237 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.219514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c0e3-150a-4214-a625-2b30c2575237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.246782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-df01c0e3-150a-4214-a625-2b30c2575237 None None] MFA Rules not processed for user `0a7b6aabfe654e57a4a0e3bed579a886`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:04.247995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-df01c0e3-150a-4214-a625-2b30c2575237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:04.248895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340c24-f1ae-4cc9-b874-e5632d7fd40e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.295319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0f84-14b5-4c20-9774-e650d5cf9f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.295997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0f84-14b5-4c20-9774-e650d5cf9f7a service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.296283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0f84-14b5-4c20-9774-e650d5cf9f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.296560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0f84-14b5-4c20-9774-e650d5cf9f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.309114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 795/1557] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:04 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:04.310393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f199649-bdf6-4757-ac62-3c750652cb22 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.310702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f199649-bdf6-4757-ac62-3c750652cb22 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.310994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f199649-bdf6-4757-ac62-3c750652cb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.337390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6f199649-bdf6-4757-ac62-3c750652cb22 None None] MFA Rules not processed for user `1ac2381138f64f1f93f65adcb313fb37`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:04.338599 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6f199649-bdf6-4757-ac62-3c750652cb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:04.354117 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0f84-14b5-4c20-9774-e650d5cf9f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.355576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0f84-14b5-4c20-9774-e650d5cf9f7a service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.364864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 763/1558] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:04.367550 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0f84-14b5-4c20-9774-e650d5cf9f7a service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.375271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0f84-14b5-4c20-9774-e650d5cf9f7a service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.379207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3a3df-e3a2-4906-b998-51b5a95d6751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.379840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3a3df-e3a2-4906-b998-51b5a95d6751 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.380157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3a3df-e3a2-4906-b998-51b5a95d6751 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.380437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3a3df-e3a2-4906-b998-51b5a95d6751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.392116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3a3df-e3a2-4906-b998-51b5a95d6751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.393418 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3a3df-e3a2-4906-b998-51b5a95d6751 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.403805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 764/1559] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:04.408923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 796/1560] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:04 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:04.409206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3a3df-e3a2-4906-b998-51b5a95d6751 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.409310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f199649-bdf6-4757-ac62-3c750652cb22 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.418046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3a3df-e3a2-4906-b998-51b5a95d6751 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.422096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403c7d1-031c-49cc-b4a5-5bd07b328000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.422858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403c7d1-031c-49cc-b4a5-5bd07b328000 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.423228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403c7d1-031c-49cc-b4a5-5bd07b328000 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.423581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403c7d1-031c-49cc-b4a5-5bd07b328000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.434391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403c7d1-031c-49cc-b4a5-5bd07b328000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.436081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403c7d1-031c-49cc-b4a5-5bd07b328000 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.447086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 765/1561] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:04.447953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403c7d1-031c-49cc-b4a5-5bd07b328000 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.462122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403c7d1-031c-49cc-b4a5-5bd07b328000 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.467490 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7307951-8289-4ab0-858b-f8b5803d473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.468615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7307951-8289-4ab0-858b-f8b5803d473b admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.468996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7307951-8289-4ab0-858b-f8b5803d473b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.469281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f199649-bdf6-4757-ac62-3c750652cb22 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.469444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7307951-8289-4ab0-858b-f8b5803d473b admin admin] PATH_INFO: `/v3/projects/03442df359a040ff915121a3170d7c78/users/8da2e813d15548b48d9871a658df4ffa/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.474494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817c693-352a-47d2-b132-5317ef18945f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.475194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817c693-352a-47d2-b132-5317ef18945f service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.475702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817c693-352a-47d2-b132-5317ef18945f service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.475822 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817c693-352a-47d2-b132-5317ef18945f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.490592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7307951-8289-4ab0-858b-f8b5803d473b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03442df359a040ff915121a3170d7c78, user_id=8da2e813d15548b48d9871a658df4ffa, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.494013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7307951-8289-4ab0-858b-f8b5803d473b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.507521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 766/1562] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:04 2021] PUT /identity/v3/projects/03442df359a040ff915121a3170d7c78/users/8da2e813d15548b48d9871a658df4ffa/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:04.509006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185a07-f019-4044-a179-1df9cc909d44 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.509427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185a07-f019-4044-a179-1df9cc909d44 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.510062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185a07-f019-4044-a179-1df9cc909d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.529463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d4185a07-f019-4044-a179-1df9cc909d44 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:04.530866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d4185a07-f019-4044-a179-1df9cc909d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:04.553684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817c693-352a-47d2-b132-5317ef18945f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.555311 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817c693-352a-47d2-b132-5317ef18945f service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.566166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 797/1563] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:04 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:04.567124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817c693-352a-47d2-b132-5317ef18945f service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.579455 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817c693-352a-47d2-b132-5317ef18945f service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.602780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 767/1564] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:04.602780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf847f-b1e2-41dd-9ffd-29068c5cdeeb None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.602780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf847f-b1e2-41dd-9ffd-29068c5cdeeb None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.602780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf847f-b1e2-41dd-9ffd-29068c5cdeeb None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.604910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 768/1565] 10.222.0.23 () {54 vars in 961 bytes} [Wed Aug 25 01:27:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:27:04.605597 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf847f-b1e2-41dd-9ffd-29068c5cdeeb None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.619592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf847f-b1e2-41dd-9ffd-29068c5cdeeb None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.624520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff4ea6-04f6-4501-b3a5-633a9a6b3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.625177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4ea6-04f6-4501-b3a5-633a9a6b3599 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.625459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4ea6-04f6-4501-b3a5-633a9a6b3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.625733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff4ea6-04f6-4501-b3a5-633a9a6b3599 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.626477 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff4ea6-04f6-4501-b3a5-633a9a6b3599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.628437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff4ea6-04f6-4501-b3a5-633a9a6b3599 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.641030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 769/1566] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:04 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:04.642505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756cda-4400-4fde-bdef-b299eb9ab432 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.642735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756cda-4400-4fde-bdef-b299eb9ab432 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.643154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756cda-4400-4fde-bdef-b299eb9ab432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.661488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70831e-ac66-4b26-848c-5d0aadb46034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.662428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70831e-ac66-4b26-848c-5d0aadb46034 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.663198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70831e-ac66-4b26-848c-5d0aadb46034 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.663198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70831e-ac66-4b26-848c-5d0aadb46034 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.664076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70831e-ac66-4b26-848c-5d0aadb46034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.664435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-0a756cda-4400-4fde-bdef-b299eb9ab432 None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:04.665652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0a756cda-4400-4fde-bdef-b299eb9ab432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:04.667673 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70831e-ac66-4b26-848c-5d0aadb46034 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.699672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 798/1567] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:04 2021] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:04.700486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70831e-ac66-4b26-848c-5d0aadb46034 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.753442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 770/1568] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Aug 25 01:27:04 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:04.756457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a756cda-4400-4fde-bdef-b299eb9ab432 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.766180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70831e-ac66-4b26-848c-5d0aadb46034 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.770080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4f09d-47fd-4492-8c4c-781603ae82f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.771420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f09d-47fd-4492-8c4c-781603ae82f5 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.771805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f09d-47fd-4492-8c4c-781603ae82f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.772239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f09d-47fd-4492-8c4c-781603ae82f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.774426 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a756cda-4400-4fde-bdef-b299eb9ab432 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.851371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4f09d-47fd-4492-8c4c-781603ae82f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.852841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4f09d-47fd-4492-8c4c-781603ae82f5 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.861186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad2ea0-2db7-4e91-a811-a62f04653eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.863404 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad2ea0-2db7-4e91-a811-a62f04653eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.864314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad2ea0-2db7-4e91-a811-a62f04653eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.865202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 799/1569] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:04.866198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4f09d-47fd-4492-8c4c-781603ae82f5 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.866431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad2ea0-2db7-4e91-a811-a62f04653eb4 admin admin] PATH_INFO: `/v3/projects/03442df359a040ff915121a3170d7c78/users/8da2e813d15548b48d9871a658df4ffa/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.874022 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad2ea0-2db7-4e91-a811-a62f04653eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03442df359a040ff915121a3170d7c78, user_id=8da2e813d15548b48d9871a658df4ffa, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.877138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4f09d-47fd-4492-8c4c-781603ae82f5 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:04.883486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528813-ec9c-4369-a3cd-fbb6156edc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:04.884581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528813-ec9c-4369-a3cd-fbb6156edc6b admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:04.884581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528813-ec9c-4369-a3cd-fbb6156edc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:04.884846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528813-ec9c-4369-a3cd-fbb6156edc6b admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:04.885767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1528813-ec9c-4369-a3cd-fbb6156edc6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:04.886077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad2ea0-2db7-4e91-a811-a62f04653eb4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.888233 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1528813-ec9c-4369-a3cd-fbb6156edc6b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:04.917747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 800/1570] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:04 2021] POST /identity/v3/users => generated 291 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:04.917747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528813-ec9c-4369-a3cd-fbb6156edc6b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:04.923663 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 771/1571] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:04 2021] PUT /identity/v3/projects/03442df359a040ff915121a3170d7c78/users/8da2e813d15548b48d9871a658df4ffa/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:04.925226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad2ea0-2db7-4e91-a811-a62f04653eb4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:05.039495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad2ea0-2db7-4e91-a811-a62f04653eb4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:05.046858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf15f07-bdad-4421-a67f-6ca94bc8e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:05.047628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf15f07-bdad-4421-a67f-6ca94bc8e8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:05.048428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf15f07-bdad-4421-a67f-6ca94bc8e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:05.048579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf15f07-bdad-4421-a67f-6ca94bc8e8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:05.049778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf15f07-bdad-4421-a67f-6ca94bc8e8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:05.052945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528813-ec9c-4369-a3cd-fbb6156edc6b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:05.053823 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf15f07-bdad-4421-a67f-6ca94bc8e8f1 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:05.076210 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 772/1572] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:04 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:05.077254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf15f07-bdad-4421-a67f-6ca94bc8e8f1 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:05.090572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf15f07-bdad-4421-a67f-6ca94bc8e8f1 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:05.098457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827d3fe-a8bb-4d16-b649-c6ef9a925b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:05.099879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d3fe-a8bb-4d16-b649-c6ef9a925b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:05.100362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d3fe-a8bb-4d16-b649-c6ef9a925b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:05.100540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d3fe-a8bb-4d16-b649-c6ef9a925b99 admin admin] PATH_INFO: `/v3/projects/e982fe514ff54077a0b7fa3ec92b6ea4/users/afe1bc3254644efb8c72d5f24c325d2f/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:05.120899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827d3fe-a8bb-4d16-b649-c6ef9a925b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e982fe514ff54077a0b7fa3ec92b6ea4, user_id=afe1bc3254644efb8c72d5f24c325d2f, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:05.124303 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827d3fe-a8bb-4d16-b649-c6ef9a925b99 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:05.150984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 773/1573] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:05 2021] PUT /identity/v3/projects/e982fe514ff54077a0b7fa3ec92b6ea4/users/afe1bc3254644efb8c72d5f24c325d2f/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:05.154316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827d3fe-a8bb-4d16-b649-c6ef9a925b99 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:05.199623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8eeeb7-823a-42ba-b7aa-bd341c244a3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:05.200346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eeeb7-823a-42ba-b7aa-bd341c244a3b service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:05.200627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eeeb7-823a-42ba-b7aa-bd341c244a3b service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:05.200954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eeeb7-823a-42ba-b7aa-bd341c244a3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:05.259676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827d3fe-a8bb-4d16-b649-c6ef9a925b99 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:05.269986 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4c8e-e4d0-45c2-88b1-d63b393a1e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:05.270949 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4c8e-e4d0-45c2-88b1-d63b393a1e58 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:05.271415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4c8e-e4d0-45c2-88b1-d63b393a1e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:05.271829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4c8e-e4d0-45c2-88b1-d63b393a1e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:05.273265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a4c8e-e4d0-45c2-88b1-d63b393a1e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:05.276264 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a4c8e-e4d0-45c2-88b1-d63b393a1e58 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:05.297166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 774/1574] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:05 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:05.299403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4c8e-e4d0-45c2-88b1-d63b393a1e58 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:05.319563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4c8e-e4d0-45c2-88b1-d63b393a1e58 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:05.333379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c2346-c5f7-447f-ad6b-7ab2222b5393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:05.334268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c2346-c5f7-447f-ad6b-7ab2222b5393 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:05.334553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c2346-c5f7-447f-ad6b-7ab2222b5393 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:05.334857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c2346-c5f7-447f-ad6b-7ab2222b5393 admin admin] PATH_INFO: `/v3/projects/e982fe514ff54077a0b7fa3ec92b6ea4/users/afe1bc3254644efb8c72d5f24c325d2f/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:05.339712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c2346-c5f7-447f-ad6b-7ab2222b5393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e982fe514ff54077a0b7fa3ec92b6ea4, user_id=afe1bc3254644efb8c72d5f24c325d2f, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:05.342439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c2346-c5f7-447f-ad6b-7ab2222b5393 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:05.343283 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8eeeb7-823a-42ba-b7aa-bd341c244a3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:05.346227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8eeeb7-823a-42ba-b7aa-bd341c244a3b service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:05.377010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 801/1575] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:04 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:05.383978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 775/1576] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:05 2021] PUT /identity/v3/projects/e982fe514ff54077a0b7fa3ec92b6ea4/users/afe1bc3254644efb8c72d5f24c325d2f/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:05.396509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aa0c6-dbb1-4ac9-8e04-2aa94361e140 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:05.396904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aa0c6-dbb1-4ac9-8e04-2aa94361e140 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:05.397351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aa0c6-dbb1-4ac9-8e04-2aa94361e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:05.448899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d11aa0c6-dbb1-4ac9-8e04-2aa94361e140 None None] MFA Rules not processed for user `afe1bc3254644efb8c72d5f24c325d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:05.450182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d11aa0c6-dbb1-4ac9-8e04-2aa94361e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:05.574127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 802/1577] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:05 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:05.585463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c2346-c5f7-447f-ad6b-7ab2222b5393 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:05.736695 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c2346-c5f7-447f-ad6b-7ab2222b5393 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:05.747473 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d05eb-0778-4101-bf85-b3303b607a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:05.748149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d05eb-0778-4101-bf85-b3303b607a33 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:05.748433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d05eb-0778-4101-bf85-b3303b607a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:05.748711 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d05eb-0778-4101-bf85-b3303b607a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:05.775914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d05eb-0778-4101-bf85-b3303b607a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:05.777371 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d05eb-0778-4101-bf85-b3303b607a33 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:05.795673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 776/1578] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:05 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:05.877224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aa0c6-dbb1-4ac9-8e04-2aa94361e140 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:05.894386 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aa0c6-dbb1-4ac9-8e04-2aa94361e140 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:05.906268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e285b-b045-4f4d-bc1e-1285a0881c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:05.907165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e285b-b045-4f4d-bc1e-1285a0881c9b service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:05.907489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e285b-b045-4f4d-bc1e-1285a0881c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:05.907767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e285b-b045-4f4d-bc1e-1285a0881c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.004486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e285b-b045-4f4d-bc1e-1285a0881c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:06.006141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e285b-b045-4f4d-bc1e-1285a0881c9b service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:06.018667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 803/1579] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:05 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:06.128111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204af8f4-3481-4dbe-962c-9f41a6d1656e None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.128563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204af8f4-3481-4dbe-962c-9f41a6d1656e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.129046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204af8f4-3481-4dbe-962c-9f41a6d1656e None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.131595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 777/1580] 10.222.0.23 () {54 vars in 961 bytes} [Wed Aug 25 01:27:06 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:27:06.141119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df793f-a5a1-43f4-b5fd-d5e4c575c758 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.141662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df793f-a5a1-43f4-b5fd-d5e4c575c758 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.142188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df793f-a5a1-43f4-b5fd-d5e4c575c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.184532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-08df793f-a5a1-43f4-b5fd-d5e4c575c758 None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:06.185843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-08df793f-a5a1-43f4-b5fd-d5e4c575c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:06.209274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3157e7-0a9f-426b-8f90-935f2279fff5 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.209562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3157e7-0a9f-426b-8f90-935f2279fff5 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.209876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3157e7-0a9f-426b-8f90-935f2279fff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.281947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-1f3157e7-0a9f-426b-8f90-935f2279fff5 None None] MFA Rules not processed for user `d2f7490ad6cf4bed96cfec8a39a65b43`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:06.283227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1f3157e7-0a9f-426b-8f90-935f2279fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:06.393304 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 804/1581] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Aug 25 01:27:06 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:06.403071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a1a5f-f3d6-4dea-be70-238922d848d1 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.403547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a1a5f-f3d6-4dea-be70-238922d848d1 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.404037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a1a5f-f3d6-4dea-be70-238922d848d1 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.406505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 805/1582] 10.222.0.23 () {54 vars in 912 bytes} [Wed Aug 25 01:27:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:27:06.414489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275424a-cfa9-48b4-aa70-6be397f332bc None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.415082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275424a-cfa9-48b4-aa70-6be397f332bc None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.415522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275424a-cfa9-48b4-aa70-6be397f332bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.443746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-3275424a-cfa9-48b4-aa70-6be397f332bc None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:06.446826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3275424a-cfa9-48b4-aa70-6be397f332bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:06.452072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 778/1583] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:06 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:06.463154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b436f2a-00f7-4b4a-b70a-a906c07bd3a1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.463453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b436f2a-00f7-4b4a-b70a-a906c07bd3a1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.463733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b436f2a-00f7-4b4a-b70a-a906c07bd3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.480186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 806/1584] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:27:06 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:06.495318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275424a-cfa9-48b4-aa70-6be397f332bc None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:06.504444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-2b436f2a-00f7-4b4a-b70a-a906c07bd3a1 None None] MFA Rules not processed for user `d2f7490ad6cf4bed96cfec8a39a65b43`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:06.508798 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2b436f2a-00f7-4b4a-b70a-a906c07bd3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:06.514484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275424a-cfa9-48b4-aa70-6be397f332bc None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:06.528056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 779/1585] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:06 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:06.530514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859e167-5b29-485f-aae7-e40fb911ee8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:06.531416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859e167-5b29-485f-aae7-e40fb911ee8d service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.531633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859e167-5b29-485f-aae7-e40fb911ee8d service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.531929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859e167-5b29-485f-aae7-e40fb911ee8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.535575 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b436f2a-00f7-4b4a-b70a-a906c07bd3a1 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:06.561545 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b436f2a-00f7-4b4a-b70a-a906c07bd3a1 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:06.571951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859e167-5b29-485f-aae7-e40fb911ee8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:06.572707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91e983-4471-406a-9b12-a80bb4f8c972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:06.573438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e983-4471-406a-9b12-a80bb4f8c972 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.573555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859e167-5b29-485f-aae7-e40fb911ee8d service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:06.573721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e983-4471-406a-9b12-a80bb4f8c972 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.574155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91e983-4471-406a-9b12-a80bb4f8c972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.591061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91e983-4471-406a-9b12-a80bb4f8c972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:06.592969 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 807/1586] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:06.593105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91e983-4471-406a-9b12-a80bb4f8c972 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:06.594356 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e263d-c668-4e57-b0cd-0ee35c83f8e9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.594670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e263d-c668-4e57-b0cd-0ee35c83f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.594981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e263d-c668-4e57-b0cd-0ee35c83f8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.626578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 780/1587] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:06 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:06.663783 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a77e263d-c668-4e57-b0cd-0ee35c83f8e9 None None] MFA Rules not processed for user `9e9bbddb949d4a47a4fbd00b9d914521`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:06.665469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a77e263d-c668-4e57-b0cd-0ee35c83f8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:06.742936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b86da-67e9-47fa-8191-b39b7e2b12db None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.743444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b86da-67e9-47fa-8191-b39b7e2b12db None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.743917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b86da-67e9-47fa-8191-b39b7e2b12db None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.746230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 781/1588] 10.222.0.23 () {54 vars in 912 bytes} [Wed Aug 25 01:27:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:27:06.752025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511532-3575-4964-af16-cc9e90a6e010 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.752645 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511532-3575-4964-af16-cc9e90a6e010 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.753559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76511532-3575-4964-af16-cc9e90a6e010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.772974 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-76511532-3575-4964-af16-cc9e90a6e010 None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:06.774281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-76511532-3575-4964-af16-cc9e90a6e010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:06.786696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 782/1589] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:27:06 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:06.799931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76511532-3575-4964-af16-cc9e90a6e010 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:06.803252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-76511532-3575-4964-af16-cc9e90a6e010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:06.812298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 808/1590] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:06 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:06.831152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d2147-0f80-4987-9f0b-f7ec3b9a3aaf None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.831697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d2147-0f80-4987-9f0b-f7ec3b9a3aaf None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.832212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d2147-0f80-4987-9f0b-f7ec3b9a3aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.901574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e75d2147-0f80-4987-9f0b-f7ec3b9a3aaf None None] MFA Rules not processed for user `9e9bbddb949d4a47a4fbd00b9d914521`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:06.907366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e75d2147-0f80-4987-9f0b-f7ec3b9a3aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:06.928756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76511532-3575-4964-af16-cc9e90a6e010 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:06.933708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fd2a1-02c1-41e0-8323-a3f75a86eb7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b9d35e26e64c959e075622321df3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:06.934174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 809/1591] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:06 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:06.934787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fd2a1-02c1-41e0-8323-a3f75a86eb7f service glance] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:06.935213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fd2a1-02c1-41e0-8323-a3f75a86eb7f service glance] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:06.935602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fd2a1-02c1-41e0-8323-a3f75a86eb7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:06.953439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fd2a1-02c1-41e0-8323-a3f75a86eb7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:06.955555 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fd2a1-02c1-41e0-8323-a3f75a86eb7f service glance] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:06.963562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d2147-0f80-4987-9f0b-f7ec3b9a3aaf None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:06.971570 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 783/1592] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:06.990945 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fd2a1-02c1-41e0-8323-a3f75a86eb7f service glance] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:07.015664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fd2a1-02c1-41e0-8323-a3f75a86eb7f service glance] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:07.033324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f597-4751-474e-90ce-7098e7138291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:07.036064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f597-4751-474e-90ce-7098e7138291 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.036998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f597-4751-474e-90ce-7098e7138291 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.038090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f597-4751-474e-90ce-7098e7138291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.065185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224f597-4751-474e-90ce-7098e7138291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:07.066914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224f597-4751-474e-90ce-7098e7138291 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:07.090321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 784/1593] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:06 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:07.108781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d2147-0f80-4987-9f0b-f7ec3b9a3aaf None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:07.128327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:07.129225 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.129512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.129790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] PATH_INFO: `/v3/users/1ac2381138f64f1f93f65adcb313fb37` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.132597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac2381138f64f1f93f65adcb313fb37)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:07.134558 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:07.240884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac2381138f64f1f93f65adcb313fb37'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:07.255780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac2381138f64f1f93f65adcb313fb37'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:07.257544 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac2381138f64f1f93f65adcb313fb37'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:07.268077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac2381138f64f1f93f65adcb313fb37'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:07.269145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2af87ed3-188a-42b4-ab80-1be25a55a9d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac2381138f64f1f93f65adcb313fb37'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:07.280653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00319c5a-ae23-495e-8b4c-2c1bfc79c25f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.281181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00319c5a-ae23-495e-8b4c-2c1bfc79c25f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.281630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00319c5a-ae23-495e-8b4c-2c1bfc79c25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.310144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 810/1594] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:06 2021] DELETE /identity/v3/users/1ac2381138f64f1f93f65adcb313fb37 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:07.315199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abb5a-6bd3-40e7-bc8c-2c00c5fcfedd None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.315534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abb5a-6bd3-40e7-bc8c-2c00c5fcfedd None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.315784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abb5a-6bd3-40e7-bc8c-2c00c5fcfedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.347532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-00319c5a-ae23-495e-8b4c-2c1bfc79c25f None None] MFA Rules not processed for user `8da2e813d15548b48d9871a658df4ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:07.349368 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-00319c5a-ae23-495e-8b4c-2c1bfc79c25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:07.370197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-ed8abb5a-6bd3-40e7-bc8c-2c00c5fcfedd None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:07.371586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ed8abb5a-6bd3-40e7-bc8c-2c00c5fcfedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:07.502276 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 785/1595] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:07 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:07.506726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 811/1596] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:07.566500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00319c5a-ae23-495e-8b4c-2c1bfc79c25f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:07.568616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-00319c5a-ae23-495e-8b4c-2c1bfc79c25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:07.641528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1406c-83db-448b-af2f-4687db6ac9ba None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.642348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1406c-83db-448b-af2f-4687db6ac9ba None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.642882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1406c-83db-448b-af2f-4687db6ac9ba None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.645492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 812/1597] 10.222.0.23 () {54 vars in 912 bytes} [Wed Aug 25 01:27:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:27:07.663252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecd01-ded7-487b-ab17-719d7955881c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.663842 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecd01-ded7-487b-ab17-719d7955881c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.664485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecd01-ded7-487b-ab17-719d7955881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.682543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00319c5a-ae23-495e-8b4c-2c1bfc79c25f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:07.689027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b82c3-b3dd-4afc-b0aa-1cb1f407ab08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:07.689027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b82c3-b3dd-4afc-b0aa-1cb1f407ab08 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.689353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b82c3-b3dd-4afc-b0aa-1cb1f407ab08 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.689701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b82c3-b3dd-4afc-b0aa-1cb1f407ab08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.714226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b82c3-b3dd-4afc-b0aa-1cb1f407ab08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:07.716076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b82c3-b3dd-4afc-b0aa-1cb1f407ab08 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:07.733308 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 786/1598] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:07.737039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c49ecd01-ded7-487b-ab17-719d7955881c None None] MFA Rules not processed for user `a08ace1a65c040bf97108a1660f962ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:07.738271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c49ecd01-ded7-487b-ab17-719d7955881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:07.747923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 813/1599] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:27:07 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:07.793261 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b82c3-b3dd-4afc-b0aa-1cb1f407ab08 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:07.804790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b82c3-b3dd-4afc-b0aa-1cb1f407ab08 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:07.811126 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9d7d4-7399-47bf-b0b2-59e0dfed8ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:07.811969 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d7d4-7399-47bf-b0b2-59e0dfed8ead service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.812611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d7d4-7399-47bf-b0b2-59e0dfed8ead service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.813243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d7d4-7399-47bf-b0b2-59e0dfed8ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.823083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca4ef0-4fb0-43b5-a512-44f2b6cd97e2 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.823373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca4ef0-4fb0-43b5-a512-44f2b6cd97e2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.823715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca4ef0-4fb0-43b5-a512-44f2b6cd97e2 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.825492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 814/1600] 10.222.0.23 () {54 vars in 912 bytes} [Wed Aug 25 01:27:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 01:27:07.835253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a5308-c284-4358-b306-9f11f55a94b2 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.835253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a5308-c284-4358-b306-9f11f55a94b2 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.835577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a5308-c284-4358-b306-9f11f55a94b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.838365 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9d7d4-7399-47bf-b0b2-59e0dfed8ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:07.844334 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9d7d4-7399-47bf-b0b2-59e0dfed8ead service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:07.864055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 787/1601] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:07 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:07.868675 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8a9a5308-c284-4358-b306-9f11f55a94b2 None None] MFA Rules not processed for user `a08ace1a65c040bf97108a1660f962ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:07.870056 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8a9a5308-c284-4358-b306-9f11f55a94b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:07.878094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 815/1602] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:27:07 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:07.909507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9d7d4-7399-47bf-b0b2-59e0dfed8ead service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:07.919159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9d7d4-7399-47bf-b0b2-59e0dfed8ead service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:07.931208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ceda5-1f29-43fe-84dd-1823a9ee7629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:07.932022 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ceda5-1f29-43fe-84dd-1823a9ee7629 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:07.932479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ceda5-1f29-43fe-84dd-1823a9ee7629 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:07.933108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ceda5-1f29-43fe-84dd-1823a9ee7629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:07.954523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ceda5-1f29-43fe-84dd-1823a9ee7629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:07.956121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ceda5-1f29-43fe-84dd-1823a9ee7629 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:07.978091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 788/1603] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:07 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:08.913918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a5308-c284-4358-b306-9f11f55a94b2 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:08.916271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8a9a5308-c284-4358-b306-9f11f55a94b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:09.084877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a5308-c284-4358-b306-9f11f55a94b2 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:09.097430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f02be8-1554-4835-ba3f-c85cbca6894a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b49222a8e4474bbe14019418ec8aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:09.097879 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f02be8-1554-4835-ba3f-c85cbca6894a service placement] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:09.099224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f02be8-1554-4835-ba3f-c85cbca6894a service placement] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:09.099224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f02be8-1554-4835-ba3f-c85cbca6894a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:09.102447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e4f02be8-1554-4835-ba3f-c85cbca6894a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:09.121749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f02be8-1554-4835-ba3f-c85cbca6894a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:09.123698 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f02be8-1554-4835-ba3f-c85cbca6894a service placement] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:09.136295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 816/1604] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:08 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:09.272529 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ceda5-1f29-43fe-84dd-1823a9ee7629 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:09.277791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1f2ceda5-1f29-43fe-84dd-1823a9ee7629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:09.330833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ceda5-1f29-43fe-84dd-1823a9ee7629 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:09.344582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:09.349002 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:09.349407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:09.349795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] PATH_INFO: `/v3/projects/1d6c251cf7e54d38a28b5fa64fd24173` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:09.351216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6c251cf7e54d38a28b5fa64fd24173)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:09.369351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:09.519663 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6c251cf7e54d38a28b5fa64fd24173', 'request_id': 'req-32a435a5-c48b-4f1a-bf42-aa870ba9876d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:09.528218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6c251cf7e54d38a28b5fa64fd24173', 'request_id': 'req-32a435a5-c48b-4f1a-bf42-aa870ba9876d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:09.543824 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6c251cf7e54d38a28b5fa64fd24173', 'request_id': 'req-32a435a5-c48b-4f1a-bf42-aa870ba9876d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:09.564479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] The token cache is being invalidate because project 1d6c251cf7e54d38a28b5fa64fd24173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:09.564776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:09.566738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-32a435a5-c48b-4f1a-bf42-aa870ba9876d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:09.569422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 789/1605] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:09 2021] DELETE /identity/v3/projects/1d6c251cf7e54d38a28b5fa64fd24173 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:09.575296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ec3f1-8920-4a38-ad49-c6c745749ecd None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:09.575787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ec3f1-8920-4a38-ad49-c6c745749ecd None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:09.576227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ec3f1-8920-4a38-ad49-c6c745749ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:09.609025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c84ec3f1-8920-4a38-ad49-c6c745749ecd None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:09.610844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c84ec3f1-8920-4a38-ad49-c6c745749ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:09.787784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 817/1606] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:09.793612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66d3ff-4bc9-4028-9b67-2fa40c6d8a76 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:09.794130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66d3ff-4bc9-4028-9b67-2fa40c6d8a76 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:09.794776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66d3ff-4bc9-4028-9b67-2fa40c6d8a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:09.855037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-ec66d3ff-4bc9-4028-9b67-2fa40c6d8a76 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:09.856387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ec66d3ff-4bc9-4028-9b67-2fa40c6d8a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:09.887337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 790/1607] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:09.891431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ec3f1-8920-4a38-ad49-c6c745749ecd None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:09.917974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ec3f1-8920-4a38-ad49-c6c745749ecd None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:09.925339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d7f1-9257-4173-8d0a-8fbc5bb2d11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:09.926287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d7f1-9257-4173-8d0a-8fbc5bb2d11e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:09.928138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d7f1-9257-4173-8d0a-8fbc5bb2d11e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:09.928630 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d7f1-9257-4173-8d0a-8fbc5bb2d11e admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:09.929542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8d7f1-9257-4173-8d0a-8fbc5bb2d11e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:09.930033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8d7f1-9257-4173-8d0a-8fbc5bb2d11e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:09.945349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8d7f1-9257-4173-8d0a-8fbc5bb2d11e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:09.982765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 818/1608] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:09.987523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66d3ff-4bc9-4028-9b67-2fa40c6d8a76 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:10.005909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66d3ff-4bc9-4028-9b67-2fa40c6d8a76 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:10.012871 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82cb84-8dbd-4cae-86f1-ecede396b1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:10.014497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82cb84-8dbd-4cae-86f1-ecede396b1ec admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:10.015050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82cb84-8dbd-4cae-86f1-ecede396b1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:10.016100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82cb84-8dbd-4cae-86f1-ecede396b1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:10.017071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82cb84-8dbd-4cae-86f1-ecede396b1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:10.019435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82cb84-8dbd-4cae-86f1-ecede396b1ec admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:10.084201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 791/1609] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:09 2021] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:10.088540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d7f1-9257-4173-8d0a-8fbc5bb2d11e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:10.100158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d7f1-9257-4173-8d0a-8fbc5bb2d11e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:10.200734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb216d-a141-4547-846b-2ec9fe6e8290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:10.201810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb216d-a141-4547-846b-2ec9fe6e8290 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:10.202872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb216d-a141-4547-846b-2ec9fe6e8290 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:10.203242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb216d-a141-4547-846b-2ec9fe6e8290 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:10.204021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb216d-a141-4547-846b-2ec9fe6e8290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:10.206162 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb216d-a141-4547-846b-2ec9fe6e8290 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:10.252478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 819/1610] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:10 2021] POST /identity/v3/users => generated 302 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:10.256614 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82cb84-8dbd-4cae-86f1-ecede396b1ec admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:10.272540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82cb84-8dbd-4cae-86f1-ecede396b1ec admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:10.279084 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dccd01-d39f-47e3-b6e1-5088045d347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:10.283770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dccd01-d39f-47e3-b6e1-5088045d347c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:10.284375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dccd01-d39f-47e3-b6e1-5088045d347c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:10.284835 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dccd01-d39f-47e3-b6e1-5088045d347c admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:10.289992 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dccd01-d39f-47e3-b6e1-5088045d347c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:10.292606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dccd01-d39f-47e3-b6e1-5088045d347c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:10.311295 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 792/1611] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:10 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:10.315600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb216d-a141-4547-846b-2ec9fe6e8290 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:10.337856 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb216d-a141-4547-846b-2ec9fe6e8290 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:10.353622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadf860-e219-4c09-a7fb-07e57eace11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:10.356015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf860-e219-4c09-a7fb-07e57eace11b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:10.356592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf860-e219-4c09-a7fb-07e57eace11b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:10.358244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf860-e219-4c09-a7fb-07e57eace11b admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:10.359212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadf860-e219-4c09-a7fb-07e57eace11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:10.360924 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadf860-e219-4c09-a7fb-07e57eace11b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:10.394963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 820/1612] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:10 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:10.400005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dccd01-d39f-47e3-b6e1-5088045d347c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:10.419788 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dccd01-d39f-47e3-b6e1-5088045d347c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:10.433360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298cf7f-3706-40cf-b1c3-e2803f814bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:10.434989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298cf7f-3706-40cf-b1c3-e2803f814bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:10.435606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298cf7f-3706-40cf-b1c3-e2803f814bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:10.436149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298cf7f-3706-40cf-b1c3-e2803f814bf2 admin admin] PATH_INFO: `/v3/projects/edca5e2bfa8d499fba98eb362747a2bd/users/7f028ee544904d2eaf7e9faea2e70dc4/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:10.478099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298cf7f-3706-40cf-b1c3-e2803f814bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edca5e2bfa8d499fba98eb362747a2bd, user_id=7f028ee544904d2eaf7e9faea2e70dc4, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:10.481341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298cf7f-3706-40cf-b1c3-e2803f814bf2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:10.530383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 793/1613] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:10 2021] PUT /identity/v3/projects/edca5e2bfa8d499fba98eb362747a2bd/users/7f028ee544904d2eaf7e9faea2e70dc4/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:10.541323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d0ea7-94f7-429e-8aed-b8164650a13b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:10.541621 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d0ea7-94f7-429e-8aed-b8164650a13b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:10.541904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d0ea7-94f7-429e-8aed-b8164650a13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:10.597864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-591d0ea7-94f7-429e-8aed-b8164650a13b None None] MFA Rules not processed for user `7f028ee544904d2eaf7e9faea2e70dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:10.599473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-591d0ea7-94f7-429e-8aed-b8164650a13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:10.747448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 821/1614] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:10 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:10.755434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298cf7f-3706-40cf-b1c3-e2803f814bf2 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:10.898320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d0ea7-94f7-429e-8aed-b8164650a13b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:10.899884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-591d0ea7-94f7-429e-8aed-b8164650a13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:10.925247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d0ea7-94f7-429e-8aed-b8164650a13b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:10.925847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298cf7f-3706-40cf-b1c3-e2803f814bf2 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:10.939943 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:10.940315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c485-a228-4943-8c41-ee890c27528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:10.941409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c485-a228-4943-8c41-ee890c27528f admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:10.941696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c485-a228-4943-8c41-ee890c27528f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:10.942160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c485-a228-4943-8c41-ee890c27528f admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:10.944352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:10.944636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45c485-a228-4943-8c41-ee890c27528f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:10.944837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:10.945742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] PATH_INFO: `/v3/users/0a7b6aabfe654e57a4a0e3bed579a886` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:10.950260 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7b6aabfe654e57a4a0e3bed579a886)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:10.952323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45c485-a228-4943-8c41-ee890c27528f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:10.954301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:11.045569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 794/1615] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:10 2021] POST /identity/v3/projects => generated 405 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:11.053977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c485-a228-4943-8c41-ee890c27528f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:11.059036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7b6aabfe654e57a4a0e3bed579a886'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:11.086541 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7b6aabfe654e57a4a0e3bed579a886'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:11.095165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7b6aabfe654e57a4a0e3bed579a886'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:11.109049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7b6aabfe654e57a4a0e3bed579a886'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:11.109049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-6dababb9-25ed-4975-99be-83b5112481f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7b6aabfe654e57a4a0e3bed579a886'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:11.135050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 822/1616] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:10 2021] DELETE /identity/v3/users/0a7b6aabfe654e57a4a0e3bed579a886 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:11.140505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8130-1eb5-4151-b285-22f50b612395 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:11.141125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8130-1eb5-4151-b285-22f50b612395 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:11.141726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8130-1eb5-4151-b285-22f50b612395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:11.189906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6fea8130-1eb5-4151-b285-22f50b612395 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:11.191570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6fea8130-1eb5-4151-b285-22f50b612395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:11.197712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c485-a228-4943-8c41-ee890c27528f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:11.302868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 823/1617] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:11.314239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2a698-d42f-4a7f-9123-c5a944535be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:11.315099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a698-d42f-4a7f-9123-c5a944535be7 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:11.315480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a698-d42f-4a7f-9123-c5a944535be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:11.315854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a698-d42f-4a7f-9123-c5a944535be7 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:11.316656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2a698-d42f-4a7f-9123-c5a944535be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:11.319830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2a698-d42f-4a7f-9123-c5a944535be7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:11.334757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea8130-1eb5-4151-b285-22f50b612395 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:11.338766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6fea8130-1eb5-4151-b285-22f50b612395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:11.374745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 795/1618] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:11 2021] POST /identity/v3/users => generated 309 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:11.380162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2a698-d42f-4a7f-9123-c5a944535be7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:11.383129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-4be2a698-d42f-4a7f-9123-c5a944535be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:11.415813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2a698-d42f-4a7f-9123-c5a944535be7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:11.434306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb159f76-814f-476c-a8c1-d5781049e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:11.436106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb159f76-814f-476c-a8c1-d5781049e0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:11.439272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb159f76-814f-476c-a8c1-d5781049e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:11.439839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb159f76-814f-476c-a8c1-d5781049e0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:11.440809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb159f76-814f-476c-a8c1-d5781049e0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:11.442736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb159f76-814f-476c-a8c1-d5781049e0a6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:11.463005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 796/1619] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:11 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:11.466653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb159f76-814f-476c-a8c1-d5781049e0a6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:11.494383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea8130-1eb5-4151-b285-22f50b612395 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:11.496884 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb159f76-814f-476c-a8c1-d5781049e0a6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:11.511605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353485e-5e67-4c47-a905-f27684236e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:11.512280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353485e-5e67-4c47-a905-f27684236e06 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:11.513068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353485e-5e67-4c47-a905-f27684236e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:11.513727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353485e-5e67-4c47-a905-f27684236e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:11.515898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff10063-26a0-4a15-b058-94ad9b93ab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:11.517210 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff10063-26a0-4a15-b058-94ad9b93ab8a admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:11.518427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff10063-26a0-4a15-b058-94ad9b93ab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:11.519435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff10063-26a0-4a15-b058-94ad9b93ab8a admin admin] PATH_INFO: `/v3/projects/eb9fb8c95b144935bad8513f8e38f8dd/users/6ceae8e93b0c4dbdb158a3845c57643a/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:11.536836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353485e-5e67-4c47-a905-f27684236e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:11.538307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353485e-5e67-4c47-a905-f27684236e06 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:11.555898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff10063-26a0-4a15-b058-94ad9b93ab8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9fb8c95b144935bad8513f8e38f8dd, user_id=6ceae8e93b0c4dbdb158a3845c57643a, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:11.558786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff10063-26a0-4a15-b058-94ad9b93ab8a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:11.564619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 824/1620] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:11.565763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353485e-5e67-4c47-a905-f27684236e06 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:11.568874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f353485e-5e67-4c47-a905-f27684236e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:11.586967 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 797/1621] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:11 2021] PUT /identity/v3/projects/eb9fb8c95b144935bad8513f8e38f8dd/users/6ceae8e93b0c4dbdb158a3845c57643a/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:11.588982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff10063-26a0-4a15-b058-94ad9b93ab8a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:11.592262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353485e-5e67-4c47-a905-f27684236e06 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:11.728373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff10063-26a0-4a15-b058-94ad9b93ab8a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:11.740737 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:11.742806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:11.743109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:11.743398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] PATH_INFO: `/v3/users/76d5a616424f46b484561537feb81270` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:11.743617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1b9e-40a5-4703-9535-d944c8104764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:11.744511 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1b9e-40a5-4703-9535-d944c8104764 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:11.744999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1b9e-40a5-4703-9535-d944c8104764 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:11.745594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1b9e-40a5-4703-9535-d944c8104764 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:11.746570 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa1b9e-40a5-4703-9535-d944c8104764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:11.747057 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d5a616424f46b484561537feb81270)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:11.750839 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:11.751407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa1b9e-40a5-4703-9535-d944c8104764 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:11.777234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 798/1622] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:11 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:11.782472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1b9e-40a5-4703-9535-d944c8104764 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:11.806445 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1b9e-40a5-4703-9535-d944c8104764 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:11.818149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cdf9a-485b-4f80-b533-86c3b5dc8eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:11.822557 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cdf9a-485b-4f80-b533-86c3b5dc8eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:11.823115 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cdf9a-485b-4f80-b533-86c3b5dc8eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:11.823745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cdf9a-485b-4f80-b533-86c3b5dc8eb7 admin admin] PATH_INFO: `/v3/projects/eb9fb8c95b144935bad8513f8e38f8dd/users/6ceae8e93b0c4dbdb158a3845c57643a/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:11.829600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cdf9a-485b-4f80-b533-86c3b5dc8eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9fb8c95b144935bad8513f8e38f8dd, user_id=6ceae8e93b0c4dbdb158a3845c57643a, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:11.832366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cdf9a-485b-4f80-b533-86c3b5dc8eb7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:11.862503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d5a616424f46b484561537feb81270'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:11.877435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 799/1623] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:11 2021] PUT /identity/v3/projects/eb9fb8c95b144935bad8513f8e38f8dd/users/6ceae8e93b0c4dbdb158a3845c57643a/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:11.888300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d5a616424f46b484561537feb81270'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:11.893025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d5a616424f46b484561537feb81270'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:11.924649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d5a616424f46b484561537feb81270'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:11.928912 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d5a616424f46b484561537feb81270'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:11.936877 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b5b6-7ce1-4f7e-b48a-7887cc97a9f3 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:11.937382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b5b6-7ce1-4f7e-b48a-7887cc97a9f3 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:11.937940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b5b6-7ce1-4f7e-b48a-7887cc97a9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:11.975463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 825/1624] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:11 2021] DELETE /identity/v3/users/76d5a616424f46b484561537feb81270 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:11.994273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-6df8b5b6-7ce1-4f7e-b48a-7887cc97a9f3 None None] MFA Rules not processed for user `6ceae8e93b0c4dbdb158a3845c57643a`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:11.996702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6df8b5b6-7ce1-4f7e-b48a-7887cc97a9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:12.153864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 800/1625] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:11 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:12.158150 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:12.160266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:12.257772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd990e-f25b-4d0e-91d8-2dd6a7bf53c0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:12.263397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f074957-bf2c-4df9-8165-e30d655c7997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:12.265011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074957-bf2c-4df9-8165-e30d655c7997 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:12.265399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074957-bf2c-4df9-8165-e30d655c7997 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:12.265946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074957-bf2c-4df9-8165-e30d655c7997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:12.278425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f074957-bf2c-4df9-8165-e30d655c7997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:12.293890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f074957-bf2c-4df9-8165-e30d655c7997 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:12.320231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 826/1626] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:12 2021] GET /identity/v3/auth/tokens => generated 3492 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:12.337348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b5b6-7ce1-4f7e-b48a-7887cc97a9f3 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:12.340279 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6df8b5b6-7ce1-4f7e-b48a-7887cc97a9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:12.430584 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b5b6-7ce1-4f7e-b48a-7887cc97a9f3 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:12.440341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:12.441511 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:12.441995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:12.443298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] PATH_INFO: `/v3/projects/d7d56f9b7b7c467da9e0b8e72a57dc30` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:12.445029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d56f9b7b7c467da9e0b8e72a57dc30)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:12.448030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:12.524194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b70aa-0c7f-43ad-a1ef-fbdcc55ba856 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:12.524489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b70aa-0c7f-43ad-a1ef-fbdcc55ba856 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:12.524763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b70aa-0c7f-43ad-a1ef-fbdcc55ba856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:12.578197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2e5b70aa-0c7f-43ad-a1ef-fbdcc55ba856 None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:12.580320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2e5b70aa-0c7f-43ad-a1ef-fbdcc55ba856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:12.582229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d56f9b7b7c467da9e0b8e72a57dc30', 'request_id': 'req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:12.599249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d56f9b7b7c467da9e0b8e72a57dc30', 'request_id': 'req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:12.616460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d56f9b7b7c467da9e0b8e72a57dc30', 'request_id': 'req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:12.667139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] The token cache is being invalidate because project d7d56f9b7b7c467da9e0b8e72a57dc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:12.667449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:12.668129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:12.669724 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 801/1627] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:12 2021] DELETE /identity/v3/projects/d7d56f9b7b7c467da9e0b8e72a57dc30 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:12.689395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:12.700092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:12.774938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 827/1628] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:27:12 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:12.805660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b70aa-0c7f-43ad-a1ef-fbdcc55ba856 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:12.807066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2e5b70aa-0c7f-43ad-a1ef-fbdcc55ba856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:12.921234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d862d5e-42e7-4d47-bfa9-132ad0e66e44 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:12.939030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:12.940366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:12.942578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:12.942843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] PATH_INFO: `/v3/users/afe1bc3254644efb8c72d5f24c325d2f` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:12.946280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe1bc3254644efb8c72d5f24c325d2f)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:12.948409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: WARNING py.warnings [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:12.948409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: warnings.warn(msg) Aug 25 01:27:12.948409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: Aug 25 01:27:12.952903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:12.987929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b70aa-0c7f-43ad-a1ef-fbdcc55ba856 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:12.999671 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:13.000586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:13.000871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:13.001150 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] PATH_INFO: `/v3/users/7f028ee544904d2eaf7e9faea2e70dc4` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:13.007341 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f028ee544904d2eaf7e9faea2e70dc4)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:13.009338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:13.094592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe1bc3254644efb8c72d5f24c325d2f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.103390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f028ee544904d2eaf7e9faea2e70dc4'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.118136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f028ee544904d2eaf7e9faea2e70dc4'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.119072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f028ee544904d2eaf7e9faea2e70dc4'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.127763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f028ee544904d2eaf7e9faea2e70dc4'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.128748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f028ee544904d2eaf7e9faea2e70dc4'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.130044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe1bc3254644efb8c72d5f24c325d2f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.130887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe1bc3254644efb8c72d5f24c325d2f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.131660 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe1bc3254644efb8c72d5f24c325d2f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.148538 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 828/1629] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:12 2021] DELETE /identity/v3/users/7f028ee544904d2eaf7e9faea2e70dc4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:13.148784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe1bc3254644efb8c72d5f24c325d2f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.149839 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:13.151616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:13.202357 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 802/1630] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:12 2021] DELETE /identity/v3/users/afe1bc3254644efb8c72d5f24c325d2f => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:13.203189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:13.206029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:13.235918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ff611-6b2a-4107-ae83-18ee14d7396b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:13.304207 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:13.305085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:13.305371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:13.307631 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] PATH_INFO: `/v3/projects/aacc1af70b1448e5a35c36fc9497a5d3` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:13.309500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aacc1af70b1448e5a35c36fc9497a5d3)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:13.310494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: WARNING py.warnings [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:13.310494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: warnings.warn(msg) Aug 25 01:27:13.310494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: Aug 25 01:27:13.311970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:13.356388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c341f1f-b955-4cf9-b05e-ebc109511dc1 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:13.399987 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aacc1af70b1448e5a35c36fc9497a5d3', 'request_id': 'req-9b0d368b-1762-4d34-ba3e-668955dc0ee9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.416298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aacc1af70b1448e5a35c36fc9497a5d3', 'request_id': 'req-9b0d368b-1762-4d34-ba3e-668955dc0ee9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.423231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aacc1af70b1448e5a35c36fc9497a5d3', 'request_id': 'req-9b0d368b-1762-4d34-ba3e-668955dc0ee9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.451140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] The token cache is being invalidate because project aacc1af70b1448e5a35c36fc9497a5d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:13.451488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.453502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9b0d368b-1762-4d34-ba3e-668955dc0ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.462712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 829/1631] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:13 2021] DELETE /identity/v3/projects/aacc1af70b1448e5a35c36fc9497a5d3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:13.464806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c56b-b798-46c5-aaf5-a4e441171dff None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:13.465105 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c56b-b798-46c5-aaf5-a4e441171dff None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:13.465531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8c56b-b798-46c5-aaf5-a4e441171dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:13.502119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-9ef8c56b-b798-46c5-aaf5-a4e441171dff None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:13.509914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9ef8c56b-b798-46c5-aaf5-a4e441171dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:13.522097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04ba45-da0c-4265-8ced-8c2ca52abce4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:13.522921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ba45-da0c-4265-8ced-8c2ca52abce4 service swift] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:13.523108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ba45-da0c-4265-8ced-8c2ca52abce4 service swift] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:13.523375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ba45-da0c-4265-8ced-8c2ca52abce4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:13.531578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2c04ba45-da0c-4265-8ced-8c2ca52abce4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:13.670950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 830/1632] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:13.671870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8c56b-b798-46c5-aaf5-a4e441171dff None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:13.676650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9ef8c56b-b798-46c5-aaf5-a4e441171dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:13.683955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04ba45-da0c-4265-8ced-8c2ca52abce4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:13.689518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04ba45-da0c-4265-8ced-8c2ca52abce4 service swift] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:13.703157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8c56b-b798-46c5-aaf5-a4e441171dff None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:13.708919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 803/1633] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:27:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:27:13.712352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:13.713253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:13.713542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:13.713817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] PATH_INFO: `/v3/users/8da2e813d15548b48d9871a658df4ffa` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:13.715077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da2e813d15548b48d9871a658df4ffa)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:13.717047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:13.803308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da2e813d15548b48d9871a658df4ffa'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.830265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04ba45-da0c-4265-8ced-8c2ca52abce4 service swift] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:13.831736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2c04ba45-da0c-4265-8ced-8c2ca52abce4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:13.873250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da2e813d15548b48d9871a658df4ffa'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.884901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da2e813d15548b48d9871a658df4ffa'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.913235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da2e813d15548b48d9871a658df4ffa'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.913235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da2e813d15548b48d9871a658df4ffa'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:13.944340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 831/1634] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:13 2021] DELETE /identity/v3/users/8da2e813d15548b48d9871a658df4ffa => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:14.045793 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04ba45-da0c-4265-8ced-8c2ca52abce4 service swift] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:14.171639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eab020-a042-4d1e-b889-bc1590f65564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:14.173585 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eab020-a042-4d1e-b889-bc1590f65564 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:14.174785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eab020-a042-4d1e-b889-bc1590f65564 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:14.175502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eab020-a042-4d1e-b889-bc1590f65564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:14.180561 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c4eab020-a042-4d1e-b889-bc1590f65564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:14.355130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eab020-a042-4d1e-b889-bc1590f65564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:14.356813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eab020-a042-4d1e-b889-bc1590f65564 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:14.384063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 804/1635] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:15.355362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:15.360595 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:15.394429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4d264-f02b-4551-a25a-73c3d121f660 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:15.405338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:15.407887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:15.408411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:15.409590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] PATH_INFO: `/v3/projects/e982fe514ff54077a0b7fa3ec92b6ea4` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:15.418590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e982fe514ff54077a0b7fa3ec92b6ea4)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:15.424065 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:15.579771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e982fe514ff54077a0b7fa3ec92b6ea4', 'request_id': 'req-904df93e-ff30-4154-a466-26b42227060f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:15.595823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e982fe514ff54077a0b7fa3ec92b6ea4', 'request_id': 'req-904df93e-ff30-4154-a466-26b42227060f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:15.611880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e982fe514ff54077a0b7fa3ec92b6ea4', 'request_id': 'req-904df93e-ff30-4154-a466-26b42227060f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:15.640684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] The token cache is being invalidate because project e982fe514ff54077a0b7fa3ec92b6ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:15.641886 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:15.643723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-904df93e-ff30-4154-a466-26b42227060f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:15.649400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 832/1636] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:15 2021] DELETE /identity/v3/projects/e982fe514ff54077a0b7fa3ec92b6ea4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:15.656319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634ec72-90be-4814-81a4-0f37c710acd2 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:15.657003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634ec72-90be-4814-81a4-0f37c710acd2 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:15.657003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634ec72-90be-4814-81a4-0f37c710acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:15.703163 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b634ec72-90be-4814-81a4-0f37c710acd2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:15.704447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b634ec72-90be-4814-81a4-0f37c710acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:15.889866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 805/1637] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:15.899096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab682fb-91a0-456c-b7ad-f43f80add498 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:15.899514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab682fb-91a0-456c-b7ad-f43f80add498 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:15.899801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab682fb-91a0-456c-b7ad-f43f80add498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:15.930062 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-3ab682fb-91a0-456c-b7ad-f43f80add498 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:15.932628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3ab682fb-91a0-456c-b7ad-f43f80add498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:15.948425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 833/1638] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:15.953862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634ec72-90be-4814-81a4-0f37c710acd2 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:15.981933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634ec72-90be-4814-81a4-0f37c710acd2 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:16.007326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088c368-4259-4dec-a725-0cc8ab713c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:16.008421 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c368-4259-4dec-a725-0cc8ab713c3b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:16.009726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c368-4259-4dec-a725-0cc8ab713c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:16.012339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c368-4259-4dec-a725-0cc8ab713c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:16.015421 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088c368-4259-4dec-a725-0cc8ab713c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:16.015928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088c368-4259-4dec-a725-0cc8ab713c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:16.024467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088c368-4259-4dec-a725-0cc8ab713c3b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:16.050131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 806/1639] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:16.054447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab682fb-91a0-456c-b7ad-f43f80add498 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:16.065477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab682fb-91a0-456c-b7ad-f43f80add498 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:16.074955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048428e1-eea7-4cfb-8195-e8b19bd52a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:16.075767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048428e1-eea7-4cfb-8195-e8b19bd52a6d admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:16.076053 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048428e1-eea7-4cfb-8195-e8b19bd52a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:16.076339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048428e1-eea7-4cfb-8195-e8b19bd52a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:16.077015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048428e1-eea7-4cfb-8195-e8b19bd52a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:16.079180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048428e1-eea7-4cfb-8195-e8b19bd52a6d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:16.088035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088c368-4259-4dec-a725-0cc8ab713c3b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:16.090080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1088c368-4259-4dec-a725-0cc8ab713c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:16.141981 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088c368-4259-4dec-a725-0cc8ab713c3b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:16.166271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:16.169077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:16.169393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:16.169633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] PATH_INFO: `/v3/projects/03442df359a040ff915121a3170d7c78` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:16.174638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03442df359a040ff915121a3170d7c78)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:16.186977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:16.190603 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 834/1640] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:16 2021] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:16.195517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048428e1-eea7-4cfb-8195-e8b19bd52a6d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:16.341847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03442df359a040ff915121a3170d7c78', 'request_id': 'req-92c39b65-a3c7-4aa2-a7a5-26a769679c87'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:16.372667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03442df359a040ff915121a3170d7c78', 'request_id': 'req-92c39b65-a3c7-4aa2-a7a5-26a769679c87'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:16.405742 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03442df359a040ff915121a3170d7c78', 'request_id': 'req-92c39b65-a3c7-4aa2-a7a5-26a769679c87'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:16.437022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048428e1-eea7-4cfb-8195-e8b19bd52a6d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:16.448160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] The token cache is being invalidate because project 03442df359a040ff915121a3170d7c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:16.448475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:16.449589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:16.452667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 807/1641] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:16 2021] DELETE /identity/v3/projects/03442df359a040ff915121a3170d7c78 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:16.453519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:16.465010 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:16.625148 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94aaf9-a44f-4099-b9ad-ff6ffeb4c84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:16.631353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94aaf9-a44f-4099-b9ad-ff6ffeb4c84f admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:16.631639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94aaf9-a44f-4099-b9ad-ff6ffeb4c84f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:16.631919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94aaf9-a44f-4099-b9ad-ff6ffeb4c84f admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:16.632638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94aaf9-a44f-4099-b9ad-ff6ffeb4c84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:16.634852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94aaf9-a44f-4099-b9ad-ff6ffeb4c84f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:16.652732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c39b65-a3c7-4aa2-a7a5-26a769679c87 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:16.672527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:16.674900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:16.681069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:16.681771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] PATH_INFO: `/v3/users/9c89701fb97d428285b06f967e77e835` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:16.684885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c89701fb97d428285b06f967e77e835)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:16.688774 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:16.703116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 835/1642] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:16 2021] POST /identity/v3/users => generated 294 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:16.703116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422e2e1-10b4-4024-a035-b643d09e81d6 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:16.703116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422e2e1-10b4-4024-a035-b643d09e81d6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:16.703116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422e2e1-10b4-4024-a035-b643d09e81d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:16.775554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-0422e2e1-10b4-4024-a035-b643d09e81d6 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:16.776903 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0422e2e1-10b4-4024-a035-b643d09e81d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:16.796511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 836/1643] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:16.797569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422e2e1-10b4-4024-a035-b643d09e81d6 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:16.800255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0422e2e1-10b4-4024-a035-b643d09e81d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:16.823054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c89701fb97d428285b06f967e77e835'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:16.824734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422e2e1-10b4-4024-a035-b643d09e81d6 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:16.831476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28a3c2-588a-4ba0-953e-e9b1bfeb8e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:16.832944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28a3c2-588a-4ba0-953e-e9b1bfeb8e37 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:16.833627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28a3c2-588a-4ba0-953e-e9b1bfeb8e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:16.834489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28a3c2-588a-4ba0-953e-e9b1bfeb8e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:16.837060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28a3c2-588a-4ba0-953e-e9b1bfeb8e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:16.842036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28a3c2-588a-4ba0-953e-e9b1bfeb8e37 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:16.847139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c89701fb97d428285b06f967e77e835'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:16.851642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c89701fb97d428285b06f967e77e835'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:16.855149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c89701fb97d428285b06f967e77e835'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:16.858406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 837/1644] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:16 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:16.858406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42582de2-93c2-4756-b973-5649db72e543 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:16.858648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42582de2-93c2-4756-b973-5649db72e543 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:16.859094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42582de2-93c2-4756-b973-5649db72e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:16.881109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-073ada97-0283-4483-90c4-6bf0e05646ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c89701fb97d428285b06f967e77e835'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:16.921888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-42582de2-93c2-4756-b973-5649db72e543 None None] MFA Rules not processed for user `a08ace1a65c040bf97108a1660f962ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:16.927199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-42582de2-93c2-4756-b973-5649db72e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:16.957542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 808/1645] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:16 2021] DELETE /identity/v3/users/9c89701fb97d428285b06f967e77e835 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:16.967057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9802a-f963-49ee-a914-cc813b209e17 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:16.967637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9802a-f963-49ee-a914-cc813b209e17 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:16.968094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9802a-f963-49ee-a914-cc813b209e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:17.028000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-19d9802a-f963-49ee-a914-cc813b209e17 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:17.029887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-19d9802a-f963-49ee-a914-cc813b209e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:17.059883 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 838/1646] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Aug 25 01:27:16 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:17.061137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42582de2-93c2-4756-b973-5649db72e543 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:17.062578 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-42582de2-93c2-4756-b973-5649db72e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:17.095783 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42582de2-93c2-4756-b973-5649db72e543 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:17.189820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 809/1647] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:17.190911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9802a-f963-49ee-a914-cc813b209e17 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:17.196267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-19d9802a-f963-49ee-a914-cc813b209e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:17.225467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9802a-f963-49ee-a914-cc813b209e17 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:17.238361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:17.239940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:17.240231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:17.240509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] PATH_INFO: `/v3/projects/edca5e2bfa8d499fba98eb362747a2bd` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:17.243538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edca5e2bfa8d499fba98eb362747a2bd)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:17.245545 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:17.273655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3b6c3-d6fa-404d-abc8-699ce748d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:17.277693 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3b6c3-d6fa-404d-abc8-699ce748d1da admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:17.283032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3b6c3-d6fa-404d-abc8-699ce748d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:17.285425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3b6c3-d6fa-404d-abc8-699ce748d1da admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:17.292349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3b6c3-d6fa-404d-abc8-699ce748d1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:17.294989 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3b6c3-d6fa-404d-abc8-699ce748d1da admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:17.339244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 839/1648] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:17 2021] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:17.340868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62084a-b3b8-4022-8206-88e4b34ae9a9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:17.343550 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62084a-b3b8-4022-8206-88e4b34ae9a9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:17.344754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62084a-b3b8-4022-8206-88e4b34ae9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:17.408606 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2e62084a-b3b8-4022-8206-88e4b34ae9a9 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:17.409979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2e62084a-b3b8-4022-8206-88e4b34ae9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:17.414194 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edca5e2bfa8d499fba98eb362747a2bd', 'request_id': 'req-cb9736a5-5621-4dff-96dd-6ede6a633447'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:17.433313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edca5e2bfa8d499fba98eb362747a2bd', 'request_id': 'req-cb9736a5-5621-4dff-96dd-6ede6a633447'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:17.450565 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edca5e2bfa8d499fba98eb362747a2bd', 'request_id': 'req-cb9736a5-5621-4dff-96dd-6ede6a633447'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:17.492766 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] The token cache is being invalidate because project edca5e2bfa8d499fba98eb362747a2bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:17.495161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:17.501065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:17.504557 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 810/1649] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:17 2021] DELETE /identity/v3/projects/edca5e2bfa8d499fba98eb362747a2bd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:17.509533 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:17.513150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:17.597870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 840/1650] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:17.599054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62084a-b3b8-4022-8206-88e4b34ae9a9 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:17.603851 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2e62084a-b3b8-4022-8206-88e4b34ae9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:17.639509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62084a-b3b8-4022-8206-88e4b34ae9a9 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:17.641050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9736a5-5621-4dff-96dd-6ede6a633447 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:17.645483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9be47-c415-48c1-87b5-9d3c41cb4c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:17.646299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9be47-c415-48c1-87b5-9d3c41cb4c8d service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:17.646721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9be47-c415-48c1-87b5-9d3c41cb4c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:17.647154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9be47-c415-48c1-87b5-9d3c41cb4c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:17.649120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3ae9be47-c415-48c1-87b5-9d3c41cb4c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:17.652211 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b40cc2-066d-4c6a-9caa-158c23beb5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:17.653873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40cc2-066d-4c6a-9caa-158c23beb5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:17.654029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40cc2-066d-4c6a-9caa-158c23beb5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:17.654296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40cc2-066d-4c6a-9caa-158c23beb5b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:17.658533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b40cc2-066d-4c6a-9caa-158c23beb5b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:17.658954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b40cc2-066d-4c6a-9caa-158c23beb5b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:17.660647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b40cc2-066d-4c6a-9caa-158c23beb5b3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:17.661847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9be47-c415-48c1-87b5-9d3c41cb4c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:17.663998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9be47-c415-48c1-87b5-9d3c41cb4c8d service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:17.681884 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 811/1651] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:17 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:17.682956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9be47-c415-48c1-87b5-9d3c41cb4c8d service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:17.687845 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3ae9be47-c415-48c1-87b5-9d3c41cb4c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:17.709267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 841/1652] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:17.709267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b40cc2-066d-4c6a-9caa-158c23beb5b3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:17.714569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-30b40cc2-066d-4c6a-9caa-158c23beb5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:17.726773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9be47-c415-48c1-87b5-9d3c41cb4c8d service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:17.754554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cafe8-1c3e-4521-9d0f-b91d7afc3289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:17.756001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cafe8-1c3e-4521-9d0f-b91d7afc3289 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:17.756503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cafe8-1c3e-4521-9d0f-b91d7afc3289 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:17.756952 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cafe8-1c3e-4521-9d0f-b91d7afc3289 admin admin] PATH_INFO: `/v3/projects/d8dbc56bdaec4dd8babda413796e4842/users/3b76fdd880d8459e869d05b4b9ef4f1d/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:17.762034 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b40cc2-066d-4c6a-9caa-158c23beb5b3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:17.776051 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:17.777848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:17.778305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:17.778770 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] PATH_INFO: `/v3/users/6ceae8e93b0c4dbdb158a3845c57643a` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:17.781010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ceae8e93b0c4dbdb158a3845c57643a)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:17.787945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:17.800904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cafe8-1c3e-4521-9d0f-b91d7afc3289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8dbc56bdaec4dd8babda413796e4842, user_id=3b76fdd880d8459e869d05b4b9ef4f1d, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:17.807350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cafe8-1c3e-4521-9d0f-b91d7afc3289 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:17.870414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 812/1653] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:17 2021] PUT /identity/v3/projects/d8dbc56bdaec4dd8babda413796e4842/users/3b76fdd880d8459e869d05b4b9ef4f1d/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:17.872141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cafe8-1c3e-4521-9d0f-b91d7afc3289 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:17.884111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-149cafe8-1c3e-4521-9d0f-b91d7afc3289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:18.001911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ceae8e93b0c4dbdb158a3845c57643a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:18.031401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ceae8e93b0c4dbdb158a3845c57643a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:18.032197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ceae8e93b0c4dbdb158a3845c57643a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:18.056620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ceae8e93b0c4dbdb158a3845c57643a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:18.057649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ceae8e93b0c4dbdb158a3845c57643a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:18.064201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cafe8-1c3e-4521-9d0f-b91d7afc3289 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:18.072366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe6d6b-ebb4-43ec-8312-9d977713444a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:18.074951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe6d6b-ebb4-43ec-8312-9d977713444a service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.075680 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe6d6b-ebb4-43ec-8312-9d977713444a service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.078055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe6d6b-ebb4-43ec-8312-9d977713444a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.081472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 842/1654] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:17 2021] DELETE /identity/v3/users/6ceae8e93b0c4dbdb158a3845c57643a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:18.082562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:18.086950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:18.088219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d2fe6d6b-ebb4-43ec-8312-9d977713444a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:18.233619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe6d6b-ebb4-43ec-8312-9d977713444a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:18.234732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6369f-1974-4032-8b7c-c6f7ae1fb44e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:18.236875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe6d6b-ebb4-43ec-8312-9d977713444a service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:18.248166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb57c13-656f-426c-baa3-53ec29257d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:18.248854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb57c13-656f-426c-baa3-53ec29257d92 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.249139 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb57c13-656f-426c-baa3-53ec29257d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.249421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb57c13-656f-426c-baa3-53ec29257d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.250096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb57c13-656f-426c-baa3-53ec29257d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:18.255598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb57c13-656f-426c-baa3-53ec29257d92 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:18.257453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 813/1655] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:18.258914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8ed0c-666d-47d2-aeb4-9d7a7538bf3b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.259154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8ed0c-666d-47d2-aeb4-9d7a7538bf3b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.259395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8ed0c-666d-47d2-aeb4-9d7a7538bf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.320183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-1cc8ed0c-666d-47d2-aeb4-9d7a7538bf3b None None] MFA Rules not processed for user `3b76fdd880d8459e869d05b4b9ef4f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:18.323579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1cc8ed0c-666d-47d2-aeb4-9d7a7538bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:18.327730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 843/1656] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:18 2021] POST /identity/v3/projects => generated 379 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:18.328953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb57c13-656f-426c-baa3-53ec29257d92 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:18.482286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 814/1657] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:18 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:18.486876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8ed0c-666d-47d2-aeb4-9d7a7538bf3b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:18.491535 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb57c13-656f-426c-baa3-53ec29257d92 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:18.493473 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1cc8ed0c-666d-47d2-aeb4-9d7a7538bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:18.500490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20305cdd-d6d4-4321-a8c9-df95a8281b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:18.502329 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20305cdd-d6d4-4321-a8c9-df95a8281b43 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.503466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20305cdd-d6d4-4321-a8c9-df95a8281b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.504149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20305cdd-d6d4-4321-a8c9-df95a8281b43 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.505203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20305cdd-d6d4-4321-a8c9-df95a8281b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:18.507442 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20305cdd-d6d4-4321-a8c9-df95a8281b43 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:18.518241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8ed0c-666d-47d2-aeb4-9d7a7538bf3b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:18.533500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91139584-237d-4462-ab83-bb0182e000f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:18.534310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91139584-237d-4462-ab83-bb0182e000f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.534670 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91139584-237d-4462-ab83-bb0182e000f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.534861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91139584-237d-4462-ab83-bb0182e000f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.535485 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91139584-237d-4462-ab83-bb0182e000f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:18.538565 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91139584-237d-4462-ab83-bb0182e000f3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:18.549626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 844/1658] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:18 2021] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:18.553177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20305cdd-d6d4-4321-a8c9-df95a8281b43 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:18.573834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20305cdd-d6d4-4321-a8c9-df95a8281b43 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:18.587688 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b618de2-d0cf-484e-87e3-b528e3f07cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:18.588917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b618de2-d0cf-484e-87e3-b528e3f07cbd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.589461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b618de2-d0cf-484e-87e3-b528e3f07cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.589938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b618de2-d0cf-484e-87e3-b528e3f07cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.591287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b618de2-d0cf-484e-87e3-b528e3f07cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:18.594341 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b618de2-d0cf-484e-87e3-b528e3f07cbd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:18.600364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 815/1659] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:18 2021] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:18.604112 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91139584-237d-4462-ab83-bb0182e000f3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:18.617597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 845/1660] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:18 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:18.623205 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b618de2-d0cf-484e-87e3-b528e3f07cbd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:18.642327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b618de2-d0cf-484e-87e3-b528e3f07cbd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:18.728075 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91139584-237d-4462-ab83-bb0182e000f3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:18.746965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138a258-bf51-49cf-ba91-48a3b822283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:18.747650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138a258-bf51-49cf-ba91-48a3b822283a admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.747926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138a258-bf51-49cf-ba91-48a3b822283a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.748198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138a258-bf51-49cf-ba91-48a3b822283a admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.749503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138a258-bf51-49cf-ba91-48a3b822283a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:18.751494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138a258-bf51-49cf-ba91-48a3b822283a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:18.789572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 816/1661] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:18 2021] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:18.793585 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138a258-bf51-49cf-ba91-48a3b822283a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:18.813378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138a258-bf51-49cf-ba91-48a3b822283a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:18.826849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d49fe2-92cb-4d2a-9350-c874ae8f5b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:18.827502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d49fe2-92cb-4d2a-9350-c874ae8f5b17 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.836353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d49fe2-92cb-4d2a-9350-c874ae8f5b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.836353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d49fe2-92cb-4d2a-9350-c874ae8f5b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.836353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d49fe2-92cb-4d2a-9350-c874ae8f5b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:18.845159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d49fe2-92cb-4d2a-9350-c874ae8f5b17 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:18.850315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec015-aeaa-4173-9e34-682337b3e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:18.860309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec015-aeaa-4173-9e34-682337b3e797 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.865125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec015-aeaa-4173-9e34-682337b3e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.865884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec015-aeaa-4173-9e34-682337b3e797 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.867025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec015-aeaa-4173-9e34-682337b3e797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:18.868143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 817/1662] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:18 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:18.870670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec015-aeaa-4173-9e34-682337b3e797 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:18.875841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d49fe2-92cb-4d2a-9350-c874ae8f5b17 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:18.892055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d49fe2-92cb-4d2a-9350-c874ae8f5b17 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:18.901932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 846/1663] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:18 2021] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:18.905177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec015-aeaa-4173-9e34-682337b3e797 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:18.906799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a08f2-72fc-4593-a55e-a44013532e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:18.907712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a08f2-72fc-4593-a55e-a44013532e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.908046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a08f2-72fc-4593-a55e-a44013532e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.908273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a08f2-72fc-4593-a55e-a44013532e36 admin admin] PATH_INFO: `/v3/projects/3edb42873177479ba13ee8bee8db783b/users/5f722be55e104ccfaea2d823f7bde98c/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.933845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec015-aeaa-4173-9e34-682337b3e797 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:18.943585 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a08f2-72fc-4593-a55e-a44013532e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edb42873177479ba13ee8bee8db783b, user_id=5f722be55e104ccfaea2d823f7bde98c, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:18.946159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a08f2-72fc-4593-a55e-a44013532e36 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:18.949351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77921747-4456-435e-a28d-57f0dbcc78ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:18.952274 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77921747-4456-435e-a28d-57f0dbcc78ff admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:18.955332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77921747-4456-435e-a28d-57f0dbcc78ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:18.955892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77921747-4456-435e-a28d-57f0dbcc78ff admin admin] PATH_INFO: `/v3/projects/15a57f36ec0f4114a83a0a467e571447/users/7c1db124e7b94108ba00813e9db16a0a/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:18.970510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 818/1664] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:18 2021] PUT /identity/v3/projects/3edb42873177479ba13ee8bee8db783b/users/5f722be55e104ccfaea2d823f7bde98c/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:19.004075 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a08f2-72fc-4593-a55e-a44013532e36 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:19.015751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77921747-4456-435e-a28d-57f0dbcc78ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a57f36ec0f4114a83a0a467e571447, user_id=7c1db124e7b94108ba00813e9db16a0a, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:19.022354 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77921747-4456-435e-a28d-57f0dbcc78ff admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:19.056914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 847/1665] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:18 2021] PUT /identity/v3/projects/15a57f36ec0f4114a83a0a467e571447/users/7c1db124e7b94108ba00813e9db16a0a/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:19.126717 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f4e81-fbf3-44dc-8e7a-39cad44a3609 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:19.127230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f4e81-fbf3-44dc-8e7a-39cad44a3609 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:19.127716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f4e81-fbf3-44dc-8e7a-39cad44a3609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:19.173239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a08f2-72fc-4593-a55e-a44013532e36 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:19.177367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-906f4e81-fbf3-44dc-8e7a-39cad44a3609 None None] MFA Rules not processed for user `7c1db124e7b94108ba00813e9db16a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:19.179402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-906f4e81-fbf3-44dc-8e7a-39cad44a3609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:19.334598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecf5e7-5d98-4fe6-b723-c09e9d6817e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:19.335591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecf5e7-5d98-4fe6-b723-c09e9d6817e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:19.335883 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecf5e7-5d98-4fe6-b723-c09e9d6817e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:19.336158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecf5e7-5d98-4fe6-b723-c09e9d6817e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:19.337477 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecf5e7-5d98-4fe6-b723-c09e9d6817e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:19.339394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecf5e7-5d98-4fe6-b723-c09e9d6817e0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:19.355878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 819/1666] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:18 2021] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:19.356754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecf5e7-5d98-4fe6-b723-c09e9d6817e0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:19.369603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecf5e7-5d98-4fe6-b723-c09e9d6817e0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:19.381130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627821-47b1-4a9e-b429-31353f94eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:19.384875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 848/1667] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:19 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:19.385005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627821-47b1-4a9e-b429-31353f94eb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:19.385005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627821-47b1-4a9e-b429-31353f94eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:19.385005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627821-47b1-4a9e-b429-31353f94eb60 admin admin] PATH_INFO: `/v3/projects/3edb42873177479ba13ee8bee8db783b/users/5f722be55e104ccfaea2d823f7bde98c/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:19.386058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f4e81-fbf3-44dc-8e7a-39cad44a3609 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:19.387100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b627821-47b1-4a9e-b429-31353f94eb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edb42873177479ba13ee8bee8db783b, user_id=5f722be55e104ccfaea2d823f7bde98c, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:19.390320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b627821-47b1-4a9e-b429-31353f94eb60 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:19.413586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f4e81-fbf3-44dc-8e7a-39cad44a3609 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:19.421313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 820/1668] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:19 2021] PUT /identity/v3/projects/3edb42873177479ba13ee8bee8db783b/users/5f722be55e104ccfaea2d823f7bde98c/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:19.424013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af316eab-6540-4b87-91e6-854dff6574f6 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:19.424308 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af316eab-6540-4b87-91e6-854dff6574f6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:19.424593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af316eab-6540-4b87-91e6-854dff6574f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:19.472882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-af316eab-6540-4b87-91e6-854dff6574f6 None None] MFA Rules not processed for user `5f722be55e104ccfaea2d823f7bde98c`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:19.475864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-af316eab-6540-4b87-91e6-854dff6574f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:19.560929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a07ae6-5815-474e-952e-258fd0cba94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:19.561498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a07ae6-5815-474e-952e-258fd0cba94e admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:19.561908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a07ae6-5815-474e-952e-258fd0cba94e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:19.564821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a07ae6-5815-474e-952e-258fd0cba94e admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:19.565630 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a07ae6-5815-474e-952e-258fd0cba94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:19.579657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a07ae6-5815-474e-952e-258fd0cba94e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:19.634163 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 821/1669] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:19 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:19.640238 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af316eab-6540-4b87-91e6-854dff6574f6 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:19.642116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-af316eab-6540-4b87-91e6-854dff6574f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:19.685135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 849/1670] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:19 2021] POST /identity/v3/projects => generated 379 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:19.688212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a07ae6-5815-474e-952e-258fd0cba94e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:19.774838 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af316eab-6540-4b87-91e6-854dff6574f6 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:19.855264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a07ae6-5815-474e-952e-258fd0cba94e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:19.863240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163f64-43a6-4e1b-adaa-b906bb7d4548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:19.863699 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb5e0e-c02a-43fe-9e48-37b4782465fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:19.864569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163f64-43a6-4e1b-adaa-b906bb7d4548 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:19.864883 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163f64-43a6-4e1b-adaa-b906bb7d4548 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:19.864993 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb5e0e-c02a-43fe-9e48-37b4782465fc service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:19.865225 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a163f64-43a6-4e1b-adaa-b906bb7d4548 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:19.865321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb5e0e-c02a-43fe-9e48-37b4782465fc service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:19.865503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb5e0e-c02a-43fe-9e48-37b4782465fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:19.865852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a163f64-43a6-4e1b-adaa-b906bb7d4548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:19.873582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a163f64-43a6-4e1b-adaa-b906bb7d4548 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:19.924530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 850/1671] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:19 2021] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:19.925542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163f64-43a6-4e1b-adaa-b906bb7d4548 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:19.960644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a163f64-43a6-4e1b-adaa-b906bb7d4548 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:19.977877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f393-1b95-4f9e-a7ed-af298ddb9016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:19.979992 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f393-1b95-4f9e-a7ed-af298ddb9016 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:19.981706 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f393-1b95-4f9e-a7ed-af298ddb9016 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:19.981990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f393-1b95-4f9e-a7ed-af298ddb9016 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:19.983848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14f393-1b95-4f9e-a7ed-af298ddb9016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:19.986003 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14f393-1b95-4f9e-a7ed-af298ddb9016 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:20.008768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 851/1672] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:19 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:20.013300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f393-1b95-4f9e-a7ed-af298ddb9016 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:20.021210 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb5e0e-c02a-43fe-9e48-37b4782465fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:20.022602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb5e0e-c02a-43fe-9e48-37b4782465fc service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:20.038232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f393-1b95-4f9e-a7ed-af298ddb9016 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:20.047345 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 822/1673] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:19 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:20.049847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ad469-e82e-44ff-b656-e8dc233f8a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:20.050976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ad469-e82e-44ff-b656-e8dc233f8a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:20.051509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ad469-e82e-44ff-b656-e8dc233f8a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:20.051965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ad469-e82e-44ff-b656-e8dc233f8a25 admin admin] PATH_INFO: `/v3/projects/1f19b87847ed4b4da680bf6bcb51c860/users/5a8d4780e576447fbdef126dff6ee709/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:20.087610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ad469-e82e-44ff-b656-e8dc233f8a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f19b87847ed4b4da680bf6bcb51c860, user_id=5a8d4780e576447fbdef126dff6ee709, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:20.093852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ad469-e82e-44ff-b656-e8dc233f8a25 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:20.097783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb5e0e-c02a-43fe-9e48-37b4782465fc service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:20.113647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb5e0e-c02a-43fe-9e48-37b4782465fc service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:20.132995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 852/1674] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:20 2021] PUT /identity/v3/projects/1f19b87847ed4b4da680bf6bcb51c860/users/5a8d4780e576447fbdef126dff6ee709/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:20.142921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ad469-e82e-44ff-b656-e8dc233f8a25 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:20.220960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:20.224997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:20.225518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:20.225673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] PATH_INFO: `/v3/users/3b76fdd880d8459e869d05b4b9ef4f1d` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:20.229539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b76fdd880d8459e869d05b4b9ef4f1d)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:20.233862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:20.335975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ad469-e82e-44ff-b656-e8dc233f8a25 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:20.341756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b76fdd880d8459e869d05b4b9ef4f1d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:20.344920 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb23a4f-5eb3-42de-a537-f8c3d4d1b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:20.345739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb23a4f-5eb3-42de-a537-f8c3d4d1b8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:20.346109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb23a4f-5eb3-42de-a537-f8c3d4d1b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:20.346615 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb23a4f-5eb3-42de-a537-f8c3d4d1b8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:20.347444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb23a4f-5eb3-42de-a537-f8c3d4d1b8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:20.349186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb23a4f-5eb3-42de-a537-f8c3d4d1b8b4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:20.350453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b76fdd880d8459e869d05b4b9ef4f1d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:20.351300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b76fdd880d8459e869d05b4b9ef4f1d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:20.351990 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b76fdd880d8459e869d05b4b9ef4f1d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:20.361749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0bd6cefb-8d8b-415a-b88a-c059eb42365d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b76fdd880d8459e869d05b4b9ef4f1d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:20.379489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 853/1675] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:20 2021] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:20.380981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb23a4f-5eb3-42de-a537-f8c3d4d1b8b4 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:20.393951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 823/1676] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:20 2021] DELETE /identity/v3/users/3b76fdd880d8459e869d05b4b9ef4f1d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:20.397996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9bb23a4f-5eb3-42de-a537-f8c3d4d1b8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:20.402257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751e749-3627-4b38-81df-3911b12ce3b1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:20.403322 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751e749-3627-4b38-81df-3911b12ce3b1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:20.404259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751e749-3627-4b38-81df-3911b12ce3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:20.422757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb23a4f-5eb3-42de-a537-f8c3d4d1b8b4 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:20.462393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-1751e749-3627-4b38-81df-3911b12ce3b1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:20.472092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1751e749-3627-4b38-81df-3911b12ce3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:20.592467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 824/1677] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:20.593917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751e749-3627-4b38-81df-3911b12ce3b1 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:20.596540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1751e749-3627-4b38-81df-3911b12ce3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:20.601066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b143c-4916-48b6-94bf-1c065abeee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:20.602016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b143c-4916-48b6-94bf-1c065abeee90 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:20.602300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b143c-4916-48b6-94bf-1c065abeee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:20.602575 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b143c-4916-48b6-94bf-1c065abeee90 admin admin] PATH_INFO: `/v3/projects/1f19b87847ed4b4da680bf6bcb51c860/users/5a8d4780e576447fbdef126dff6ee709/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:20.615674 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b143c-4916-48b6-94bf-1c065abeee90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f19b87847ed4b4da680bf6bcb51c860, user_id=5a8d4780e576447fbdef126dff6ee709, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:20.616693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751e749-3627-4b38-81df-3911b12ce3b1 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:20.618376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b143c-4916-48b6-94bf-1c065abeee90 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:20.622111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:20.623338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:20.623963 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:20.624769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] PATH_INFO: `/v3/projects/3a2cd2d9105c4b869f11980f87585b4b` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:20.627726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2cd2d9105c4b869f11980f87585b4b)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:20.630970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:20.691861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 854/1678] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:20 2021] PUT /identity/v3/projects/1f19b87847ed4b4da680bf6bcb51c860/users/5a8d4780e576447fbdef126dff6ee709/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:20.694119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b380bf-4f7f-4b06-882f-59a62356eb70 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:20.694412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b380bf-4f7f-4b06-882f-59a62356eb70 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:20.694729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b380bf-4f7f-4b06-882f-59a62356eb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:20.719525 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2cd2d9105c4b869f11980f87585b4b', 'request_id': 'req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:20.737083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2cd2d9105c4b869f11980f87585b4b', 'request_id': 'req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:20.773332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2cd2d9105c4b869f11980f87585b4b', 'request_id': 'req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:20.814560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-81b380bf-4f7f-4b06-882f-59a62356eb70 None None] MFA Rules not processed for user `5a8d4780e576447fbdef126dff6ee709`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:20.815902 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-81b380bf-4f7f-4b06-882f-59a62356eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:20.843074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] The token cache is being invalidate because project 3a2cd2d9105c4b869f11980f87585b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:20.844621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:20.847812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:20.861781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 825/1679] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:20 2021] DELETE /identity/v3/projects/3a2cd2d9105c4b869f11980f87585b4b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:20.862837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:20.868233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:21.000026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c58a2d-f9c6-4e0d-b03a-0e0ddb51662d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:21.004457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a00c9-3dab-4b25-ab96-f805e35c0a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:21.006092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a00c9-3dab-4b25-ab96-f805e35c0a27 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:21.006364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a00c9-3dab-4b25-ab96-f805e35c0a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:21.006736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a00c9-3dab-4b25-ab96-f805e35c0a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:21.011955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-375a00c9-3dab-4b25-ab96-f805e35c0a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:21.064563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 855/1680] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:20 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:21.071444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459a17-4307-458e-b34b-0a9c95e3e82a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:21.071739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459a17-4307-458e-b34b-0a9c95e3e82a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:21.072027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459a17-4307-458e-b34b-0a9c95e3e82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:21.111383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-bb459a17-4307-458e-b34b-0a9c95e3e82a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:21.112675 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-bb459a17-4307-458e-b34b-0a9c95e3e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:21.152014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a00c9-3dab-4b25-ab96-f805e35c0a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:21.153476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a00c9-3dab-4b25-ab96-f805e35c0a27 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:21.174135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 826/1681] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:21.175045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a00c9-3dab-4b25-ab96-f805e35c0a27 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:21.179859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-375a00c9-3dab-4b25-ab96-f805e35c0a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:21.284251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 856/1682] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:21.286346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d82707-073e-4307-8c29-3e719a6d3f0b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:21.286711 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d82707-073e-4307-8c29-3e719a6d3f0b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:21.287019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d82707-073e-4307-8c29-3e719a6d3f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:21.339804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e6d82707-073e-4307-8c29-3e719a6d3f0b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:21.340974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e6d82707-073e-4307-8c29-3e719a6d3f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:21.343588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a00c9-3dab-4b25-ab96-f805e35c0a27 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:21.354528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09978d-8a74-4f22-a940-a55dac506e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:21.355222 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09978d-8a74-4f22-a940-a55dac506e09 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:21.355502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09978d-8a74-4f22-a940-a55dac506e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:21.355775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09978d-8a74-4f22-a940-a55dac506e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:21.361579 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 857/1683] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:21.369219 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d82707-073e-4307-8c29-3e719a6d3f0b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:21.378342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09978d-8a74-4f22-a940-a55dac506e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:21.380584 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09978d-8a74-4f22-a940-a55dac506e09 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:21.388569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d82707-073e-4307-8c29-3e719a6d3f0b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:21.395357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c3d7-2693-4437-a91b-909e002e39c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:21.396629 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c3d7-2693-4437-a91b-909e002e39c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:21.396945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c3d7-2693-4437-a91b-909e002e39c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:21.397228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91c3d7-2693-4437-a91b-909e002e39c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:21.407819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c3d7-2693-4437-a91b-909e002e39c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:21.408132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c3d7-2693-4437-a91b-909e002e39c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:21.409748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91c3d7-2693-4437-a91b-909e002e39c4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:21.420704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 827/1684] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:21 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:21.431769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 858/1685] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:21.432934 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09978d-8a74-4f22-a940-a55dac506e09 service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:21.455719 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09978d-8a74-4f22-a940-a55dac506e09 service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:21.468308 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c97e4a-5094-43d0-a267-7a0e48dc1534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:21.468976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c97e4a-5094-43d0-a267-7a0e48dc1534 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:21.469259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c97e4a-5094-43d0-a267-7a0e48dc1534 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:21.472399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c97e4a-5094-43d0-a267-7a0e48dc1534 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:21.473174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c97e4a-5094-43d0-a267-7a0e48dc1534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:21.484014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c97e4a-5094-43d0-a267-7a0e48dc1534 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:21.556995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 828/1686] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:21 2021] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:21.564251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c3d7-2693-4437-a91b-909e002e39c4 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:21.590325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91c3d7-2693-4437-a91b-909e002e39c4 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:21.702369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c97e4a-5094-43d0-a267-7a0e48dc1534 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:21.704905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-41c97e4a-5094-43d0-a267-7a0e48dc1534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:21.765479 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b753184-f7b8-4f70-bc19-a278c7ddac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:21.766211 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b753184-f7b8-4f70-bc19-a278c7ddac2e admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:21.766407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b753184-f7b8-4f70-bc19-a278c7ddac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:21.766859 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b753184-f7b8-4f70-bc19-a278c7ddac2e admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:21.767697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b753184-f7b8-4f70-bc19-a278c7ddac2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:21.773707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b753184-f7b8-4f70-bc19-a278c7ddac2e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:21.829466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 859/1687] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:21 2021] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:21.838289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b753184-f7b8-4f70-bc19-a278c7ddac2e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:21.872568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b753184-f7b8-4f70-bc19-a278c7ddac2e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:21.880438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c97e4a-5094-43d0-a267-7a0e48dc1534 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:21.887878 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a6357-d997-4931-bee1-3802144e42fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:21.890796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a6357-d997-4931-bee1-3802144e42fb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:21.894653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a6357-d997-4931-bee1-3802144e42fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:21.894978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a6357-d997-4931-bee1-3802144e42fb admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:21.895819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a6357-d997-4931-bee1-3802144e42fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:21.900180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:21.901281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:21.901568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:21.901891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] PATH_INFO: `/v3/projects/eb9fb8c95b144935bad8513f8e38f8dd` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:21.902433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a6357-d997-4931-bee1-3802144e42fb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:21.912296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9fb8c95b144935bad8513f8e38f8dd)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:21.914722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:21.955188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 860/1688] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:21 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:21.958025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a6357-d997-4931-bee1-3802144e42fb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:21.998465 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a6357-d997-4931-bee1-3802144e42fb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:22.011602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524379c-4e88-4098-825c-c67724c2d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:22.012554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524379c-4e88-4098-825c-c67724c2d17e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:22.013196 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524379c-4e88-4098-825c-c67724c2d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:22.013617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524379c-4e88-4098-825c-c67724c2d17e admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:22.015867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524379c-4e88-4098-825c-c67724c2d17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:22.019920 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524379c-4e88-4098-825c-c67724c2d17e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:22.058863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 861/1689] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:21 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:22.059996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524379c-4e88-4098-825c-c67724c2d17e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:22.079187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9fb8c95b144935bad8513f8e38f8dd', 'request_id': 'req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:22.082695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524379c-4e88-4098-825c-c67724c2d17e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:22.115908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9fb8c95b144935bad8513f8e38f8dd', 'request_id': 'req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:22.130877 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9fb8c95b144935bad8513f8e38f8dd', 'request_id': 'req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:22.155286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] The token cache is being invalidate because project eb9fb8c95b144935bad8513f8e38f8dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:22.155603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:22.156349 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee66e8e3-d5d9-4f49-8fdc-8672c529aa40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:22.158664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 829/1690] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:21 2021] DELETE /identity/v3/projects/eb9fb8c95b144935bad8513f8e38f8dd => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:22.178968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ffa57-4fa8-42b0-8add-b0a54f2c4615 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:22.186732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ffa57-4fa8-42b0-8add-b0a54f2c4615 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:22.186732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ffa57-4fa8-42b0-8add-b0a54f2c4615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:22.264762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb9439-d045-4e23-8f3c-d681469c2cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:22.265684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb9439-d045-4e23-8f3c-d681469c2cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:22.265959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb9439-d045-4e23-8f3c-d681469c2cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:22.266229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb9439-d045-4e23-8f3c-d681469c2cbc admin admin] PATH_INFO: `/v3/projects/ab15ba44fef84cc9a082325c03f8eaa3/users/ddcf074fc4dc4e629cd8efa1f9c17b8d/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:22.298919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb9439-d045-4e23-8f3c-d681469c2cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab15ba44fef84cc9a082325c03f8eaa3, user_id=ddcf074fc4dc4e629cd8efa1f9c17b8d, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:22.309358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-630ffa57-4fa8-42b0-8add-b0a54f2c4615 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:22.310353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb9439-d045-4e23-8f3c-d681469c2cbc admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:22.314388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-630ffa57-4fa8-42b0-8add-b0a54f2c4615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:22.372163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 862/1691] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:22 2021] PUT /identity/v3/projects/ab15ba44fef84cc9a082325c03f8eaa3/users/ddcf074fc4dc4e629cd8efa1f9c17b8d/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:22.372163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb9439-d045-4e23-8f3c-d681469c2cbc admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:22.372458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 830/1692] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:22.375555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5dcb9439-d045-4e23-8f3c-d681469c2cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:22.379076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456748b-ac3d-4746-8d21-8b1728c0a569 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:22.379360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456748b-ac3d-4746-8d21-8b1728c0a569 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:22.380258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456748b-ac3d-4746-8d21-8b1728c0a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:22.459094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-f456748b-ac3d-4746-8d21-8b1728c0a569 None None] MFA Rules not processed for user `ddcf074fc4dc4e629cd8efa1f9c17b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:22.460435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f456748b-ac3d-4746-8d21-8b1728c0a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:22.600215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb9439-d045-4e23-8f3c-d681469c2cbc admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:22.612336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db54f1-8523-473c-8918-52f0b1650220 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8d4780e576447fbdef126dff6ee709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f19b87847ed4b4da680bf6bcb51c860', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:22.613376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db54f1-8523-473c-8918-52f0b1650220 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:22.631495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db54f1-8523-473c-8918-52f0b1650220 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:22.633235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db54f1-8523-473c-8918-52f0b1650220 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:22.635619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db54f1-8523-473c-8918-52f0b1650220 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:22.636124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db54f1-8523-473c-8918-52f0b1650220 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:22.643123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db54f1-8523-473c-8918-52f0b1650220 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:22.663069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 831/1693] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:22 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:22.664652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91f95e-ea7d-4bb4-b85a-ac1e753b08e4 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:22.665090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91f95e-ea7d-4bb4-b85a-ac1e753b08e4 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:22.665522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91f95e-ea7d-4bb4-b85a-ac1e753b08e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:22.684592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 863/1694] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:22.686364 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ed6c-7c9c-4c60-b554-9d9e5752b21a None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:22.687018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ed6c-7c9c-4c60-b554-9d9e5752b21a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:22.690484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ed6c-7c9c-4c60-b554-9d9e5752b21a None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:22.692559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 864/1695] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 25 01:27:22 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:27:22.696118 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-5f91f95e-ea7d-4bb4-b85a-ac1e753b08e4 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:22.697163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ed6c-7c9c-4c60-b554-9d9e5752b21a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:22.704522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5f91f95e-ea7d-4bb4-b85a-ac1e753b08e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:22.707772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2d36ed6c-7c9c-4c60-b554-9d9e5752b21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:22.871566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ed6c-7c9c-4c60-b554-9d9e5752b21a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:22.885138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1f870-44c0-4a07-b812-6809aea2d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:22.886929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1f870-44c0-4a07-b812-6809aea2d048 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:22.887356 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1f870-44c0-4a07-b812-6809aea2d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:22.887772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1f870-44c0-4a07-b812-6809aea2d048 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:22.888750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1f870-44c0-4a07-b812-6809aea2d048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:22.891204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1f870-44c0-4a07-b812-6809aea2d048 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:22.921201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 832/1696] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:22.922087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91f95e-ea7d-4bb4-b85a-ac1e753b08e4 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:22.942930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 865/1697] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:22 2021] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:22.944530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe542-aab5-443a-a146-215861ec5b80 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:22.944984 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe542-aab5-443a-a146-215861ec5b80 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:22.945424 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe542-aab5-443a-a146-215861ec5b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:22.954816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91f95e-ea7d-4bb4-b85a-ac1e753b08e4 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:22.985941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8d4fe542-aab5-443a-a146-215861ec5b80 None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:22.987345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8d4fe542-aab5-443a-a146-215861ec5b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:23.111839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858973-3e15-4d4a-85f1-0435363ddd20 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8d4780e576447fbdef126dff6ee709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f19b87847ed4b4da680bf6bcb51c860', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:23.114409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858973-3e15-4d4a-85f1-0435363ddd20 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:23.115485 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858973-3e15-4d4a-85f1-0435363ddd20 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:23.116665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55858973-3e15-4d4a-85f1-0435363ddd20 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:23.118801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858973-3e15-4d4a-85f1-0435363ddd20 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:23.124956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55858973-3e15-4d4a-85f1-0435363ddd20 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:23.134750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 866/1698] 10.222.0.23 () {58 vars in 1019 bytes} [Wed Aug 25 01:27:22 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:23.135977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fe542-aab5-443a-a146-215861ec5b80 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:23.183642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 833/1699] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:22 2021] POST /identity/v3/projects => generated 355 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:23.184758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858973-3e15-4d4a-85f1-0435363ddd20 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:23.265581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fe542-aab5-443a-a146-215861ec5b80 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:23.324023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55858973-3e15-4d4a-85f1-0435363ddd20 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:23.338881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845295d-a5b5-4d0f-89de-f2f16c16a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:23.339670 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845295d-a5b5-4d0f-89de-f2f16c16a5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:23.339962 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845295d-a5b5-4d0f-89de-f2f16c16a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:23.340252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845295d-a5b5-4d0f-89de-f2f16c16a5f9 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:23.341109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845295d-a5b5-4d0f-89de-f2f16c16a5f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:23.343089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845295d-a5b5-4d0f-89de-f2f16c16a5f9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:23.375078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe5277-6054-4218-ad6b-0fea66237078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:23.376141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe5277-6054-4218-ad6b-0fea66237078 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:23.376562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe5277-6054-4218-ad6b-0fea66237078 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:23.377053 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe5277-6054-4218-ad6b-0fea66237078 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:23.378750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe5277-6054-4218-ad6b-0fea66237078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:23.379245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe5277-6054-4218-ad6b-0fea66237078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:23.382234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe5277-6054-4218-ad6b-0fea66237078 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:23.384169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 834/1700] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:23 2021] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:23.388520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845295d-a5b5-4d0f-89de-f2f16c16a5f9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:23.397616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 867/1701] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:23.398742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe5277-6054-4218-ad6b-0fea66237078 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:23.418276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe5277-6054-4218-ad6b-0fea66237078 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:23.432295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3517f-cb70-4a49-8c89-3f8dd822a988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:23.433483 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3517f-cb70-4a49-8c89-3f8dd822a988 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:23.433887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3517f-cb70-4a49-8c89-3f8dd822a988 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:23.434283 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3517f-cb70-4a49-8c89-3f8dd822a988 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:23.435191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3517f-cb70-4a49-8c89-3f8dd822a988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:23.437796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3517f-cb70-4a49-8c89-3f8dd822a988 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:23.475292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 868/1702] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:23 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:23.476387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3517f-cb70-4a49-8c89-3f8dd822a988 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:23.489550 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3517f-cb70-4a49-8c89-3f8dd822a988 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:23.501415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a6b76-3868-4d9a-be8c-ba06cf6ac2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:23.502107 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6b76-3868-4d9a-be8c-ba06cf6ac2ac admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:23.502387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6b76-3868-4d9a-be8c-ba06cf6ac2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:23.502765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6b76-3868-4d9a-be8c-ba06cf6ac2ac admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:23.503667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a6b76-3868-4d9a-be8c-ba06cf6ac2ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:23.506435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a6b76-3868-4d9a-be8c-ba06cf6ac2ac admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:23.507793 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845295d-a5b5-4d0f-89de-f2f16c16a5f9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:23.523286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b6c3a-e996-4d54-9aa9-34b1d83c98de tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8d4780e576447fbdef126dff6ee709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f19b87847ed4b4da680bf6bcb51c860', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:23.524268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b6c3a-e996-4d54-9aa9-34b1d83c98de tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:23.524712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b6c3a-e996-4d54-9aa9-34b1d83c98de tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:23.525140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b6c3a-e996-4d54-9aa9-34b1d83c98de tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:23.526029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b6c3a-e996-4d54-9aa9-34b1d83c98de tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:23.526504 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b6c3a-e996-4d54-9aa9-34b1d83c98de tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:23.528293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b6c3a-e996-4d54-9aa9-34b1d83c98de tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:23.557428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 869/1703] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:23 2021] POST /identity/v3/projects => generated 355 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:23.558455 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a6b76-3868-4d9a-be8c-ba06cf6ac2ac admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:23.575094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 835/1704] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:23.576501 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b6c3a-e996-4d54-9aa9-34b1d83c98de tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:23.600079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b6c3a-e996-4d54-9aa9-34b1d83c98de tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:23.707462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a6b76-3868-4d9a-be8c-ba06cf6ac2ac admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:23.712973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223178b-0308-47b5-b4d3-6eeb4b6aa2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:23.714327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223178b-0308-47b5-b4d3-6eeb4b6aa2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:23.714760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223178b-0308-47b5-b4d3-6eeb4b6aa2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:23.715152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223178b-0308-47b5-b4d3-6eeb4b6aa2a6 admin admin] PATH_INFO: `/v3/projects/a8a1524165b1463da5dcac318ab36ec5/users/6b2af9ab07d84fe18c8f231fd5741060/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:23.725246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752927a-937a-488a-b5e0-daa340d78865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:23.725934 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752927a-937a-488a-b5e0-daa340d78865 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:23.726220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752927a-937a-488a-b5e0-daa340d78865 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:23.726514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752927a-937a-488a-b5e0-daa340d78865 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:23.727227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752927a-937a-488a-b5e0-daa340d78865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:23.729159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752927a-937a-488a-b5e0-daa340d78865 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:23.732470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223178b-0308-47b5-b4d3-6eeb4b6aa2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a1524165b1463da5dcac318ab36ec5, user_id=6b2af9ab07d84fe18c8f231fd5741060, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:23.735527 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223178b-0308-47b5-b4d3-6eeb4b6aa2a6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:23.776321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 870/1705] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:23 2021] PUT /identity/v3/projects/a8a1524165b1463da5dcac318ab36ec5/users/6b2af9ab07d84fe18c8f231fd5741060/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:23.776886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 836/1706] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:23 2021] POST /identity/v3/users => generated 278 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:23.778085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe378d-8238-4a27-9ced-463686c39d93 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:23.778861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752927a-937a-488a-b5e0-daa340d78865 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:23.779315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe378d-8238-4a27-9ced-463686c39d93 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:23.780181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe378d-8238-4a27-9ced-463686c39d93 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:23.784480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 871/1707] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 25 01:27:23 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:27:23.789478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bbb5c-745f-4740-ad49-8deb592205dc None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:23.790235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bbb5c-745f-4740-ad49-8deb592205dc None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:23.791416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bbb5c-745f-4740-ad49-8deb592205dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:23.848079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-288bbb5c-745f-4740-ad49-8deb592205dc None None] MFA Rules not processed for user `e85a2de1c4214589916a2ef12655c5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:23.851821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-288bbb5c-745f-4740-ad49-8deb592205dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:23.953073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752927a-937a-488a-b5e0-daa340d78865 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:23.993783 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 872/1708] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:23 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:23.995109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bbb5c-745f-4740-ad49-8deb592205dc None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:24.068756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8d4780e576447fbdef126dff6ee709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f19b87847ed4b4da680bf6bcb51c860', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:24.069638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.069929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.070215 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] PATH_INFO: `/v3/projects/7344f5490d19470ab7f135ed63932c16` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.071469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7344f5490d19470ab7f135ed63932c16)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:24.072197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bbb5c-745f-4740-ad49-8deb592205dc None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:24.073590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:24.079256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f15ab-09ad-4285-a8b9-47c773517aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:24.080932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f15ab-09ad-4285-a8b9-47c773517aae admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.081446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f15ab-09ad-4285-a8b9-47c773517aae admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.081951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f15ab-09ad-4285-a8b9-47c773517aae admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.084102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f15ab-09ad-4285-a8b9-47c773517aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:24.088972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f15ab-09ad-4285-a8b9-47c773517aae admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:24.114243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 873/1709] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:23 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:24.114699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f15ab-09ad-4285-a8b9-47c773517aae admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:24.133557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f15ab-09ad-4285-a8b9-47c773517aae admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:24.159546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7344f5490d19470ab7f135ed63932c16', 'request_id': 'req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:24.172053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7344f5490d19470ab7f135ed63932c16', 'request_id': 'req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:24.180336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7344f5490d19470ab7f135ed63932c16', 'request_id': 'req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:24.202606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] The token cache is being invalidate because project 7344f5490d19470ab7f135ed63932c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:24.203181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:24.203999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6dc358b9-5959-4139-9b29-ceb12eb0f8e0 tempest-VolumeQuotaClassesTest-755957904 tempest-VolumeQuotaClassesTest-755957904-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:24.205745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 837/1710] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:23 2021] DELETE /identity/v3/projects/7344f5490d19470ab7f135ed63932c16 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:24.207480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66c135-3494-45d7-a340-f2a9bacfb682 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.208747 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66c135-3494-45d7-a340-f2a9bacfb682 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.209602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66c135-3494-45d7-a340-f2a9bacfb682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.235096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-8a66c135-3494-45d7-a340-f2a9bacfb682 None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:24.236839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8a66c135-3494-45d7-a340-f2a9bacfb682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.276714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951a6c-e059-429c-aa16-c6ce3e30ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:24.277570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951a6c-e059-429c-aa16-c6ce3e30ef8d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.278026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951a6c-e059-429c-aa16-c6ce3e30ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.278582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951a6c-e059-429c-aa16-c6ce3e30ef8d admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.279469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8951a6c-e059-429c-aa16-c6ce3e30ef8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:24.281241 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8951a6c-e059-429c-aa16-c6ce3e30ef8d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:24.317597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 874/1711] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:24.321693 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951a6c-e059-429c-aa16-c6ce3e30ef8d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:24.327482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c8951a6c-e059-429c-aa16-c6ce3e30ef8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.358077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951a6c-e059-429c-aa16-c6ce3e30ef8d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:24.367597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:24.369284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.370123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.370663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] PATH_INFO: `/v3/projects/d8dbc56bdaec4dd8babda413796e4842` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.373315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8dbc56bdaec4dd8babda413796e4842)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:24.376576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:24.402781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 838/1712] 10.222.0.23 () {58 vars in 1019 bytes} [Wed Aug 25 01:27:24 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:24.404155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66c135-3494-45d7-a340-f2a9bacfb682 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:24.408149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8a66c135-3494-45d7-a340-f2a9bacfb682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.435374 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66c135-3494-45d7-a340-f2a9bacfb682 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:24.444113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8dbc56bdaec4dd8babda413796e4842', 'request_id': 'req-e817e1cb-f5bc-41c3-9742-543509f67a37'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:24.457921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8dbc56bdaec4dd8babda413796e4842', 'request_id': 'req-e817e1cb-f5bc-41c3-9742-543509f67a37'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:24.467142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8dbc56bdaec4dd8babda413796e4842', 'request_id': 'req-e817e1cb-f5bc-41c3-9742-543509f67a37'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:24.485514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] The token cache is being invalidate because project d8dbc56bdaec4dd8babda413796e4842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:24.485968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:24.487049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:24.491155 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 875/1713] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:24 2021] DELETE /identity/v3/projects/d8dbc56bdaec4dd8babda413796e4842 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:24.492382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:24.498652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.528260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039335f-4612-4b44-b204-068511d4d58a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:24.529105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039335f-4612-4b44-b204-068511d4d58a service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.531062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039335f-4612-4b44-b204-068511d4d58a service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.532081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039335f-4612-4b44-b204-068511d4d58a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.536482 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0039335f-4612-4b44-b204-068511d4d58a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.561457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039335f-4612-4b44-b204-068511d4d58a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:24.563791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039335f-4612-4b44-b204-068511d4d58a service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:24.587006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 839/1714] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:24 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:24.588464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039335f-4612-4b44-b204-068511d4d58a service nova] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:24.593332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0039335f-4612-4b44-b204-068511d4d58a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.594772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817e1cb-f5bc-41c3-9742-543509f67a37 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:24.610035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942762e1-9c04-4b04-8ac3-5a58fbe7bb03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:24.610713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942762e1-9c04-4b04-8ac3-5a58fbe7bb03 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.611000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942762e1-9c04-4b04-8ac3-5a58fbe7bb03 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.611268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942762e1-9c04-4b04-8ac3-5a58fbe7bb03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.615684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-942762e1-9c04-4b04-8ac3-5a58fbe7bb03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.689166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039335f-4612-4b44-b204-068511d4d58a service nova] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:24.695098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572792d-e145-4d43-bdc1-cb1b2191eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:24.696149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572792d-e145-4d43-bdc1-cb1b2191eb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.696433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572792d-e145-4d43-bdc1-cb1b2191eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.696708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572792d-e145-4d43-bdc1-cb1b2191eb6a admin admin] PATH_INFO: `/v3/projects/a8a1524165b1463da5dcac318ab36ec5/users/6b2af9ab07d84fe18c8f231fd5741060/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.698868 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572792d-e145-4d43-bdc1-cb1b2191eb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a1524165b1463da5dcac318ab36ec5, user_id=6b2af9ab07d84fe18c8f231fd5741060, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:24.701528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572792d-e145-4d43-bdc1-cb1b2191eb6a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:24.704371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942762e1-9c04-4b04-8ac3-5a58fbe7bb03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:24.706087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942762e1-9c04-4b04-8ac3-5a58fbe7bb03 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:24.716018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 876/1715] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:24 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:24.726712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d707202-bf75-49c5-b42d-b29c887fc5f3 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.726712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d707202-bf75-49c5-b42d-b29c887fc5f3 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.726712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d707202-bf75-49c5-b42d-b29c887fc5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.728269 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 840/1716] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:24 2021] PUT /identity/v3/projects/a8a1524165b1463da5dcac318ab36ec5/users/6b2af9ab07d84fe18c8f231fd5741060/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:24.736407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572792d-e145-4d43-bdc1-cb1b2191eb6a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:24.745243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c572792d-e145-4d43-bdc1-cb1b2191eb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.778015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-3d707202-bf75-49c5-b42d-b29c887fc5f3 None None] MFA Rules not processed for user `ae3376227e8648fb9d2e46875db4b998`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:24.780153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3d707202-bf75-49c5-b42d-b29c887fc5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.846595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572792d-e145-4d43-bdc1-cb1b2191eb6a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:24.854439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05035cd-c0a2-41de-9cc8-02c61213ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:24.855149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05035cd-c0a2-41de-9cc8-02c61213ad63 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.855429 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05035cd-c0a2-41de-9cc8-02c61213ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.855705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05035cd-c0a2-41de-9cc8-02c61213ad63 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.856436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05035cd-c0a2-41de-9cc8-02c61213ad63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:24.858025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05035cd-c0a2-41de-9cc8-02c61213ad63 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:24.867873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 877/1717] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:24.867873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d707202-bf75-49c5-b42d-b29c887fc5f3 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:24.867873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3d707202-bf75-49c5-b42d-b29c887fc5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.892567 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 841/1718] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:24.892768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d707202-bf75-49c5-b42d-b29c887fc5f3 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:24.892879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05035cd-c0a2-41de-9cc8-02c61213ad63 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:24.894875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d05035cd-c0a2-41de-9cc8-02c61213ad63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:24.896510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:24.901975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.902328 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.902620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] PATH_INFO: `/v3/users/5f722be55e104ccfaea2d823f7bde98c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.904415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f722be55e104ccfaea2d823f7bde98c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:24.906584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:24.935908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05035cd-c0a2-41de-9cc8-02c61213ad63 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:24.943474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:24.944822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:24.945124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:24.945614 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] PATH_INFO: `/v3/users/7c1db124e7b94108ba00813e9db16a0a` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:24.947648 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1db124e7b94108ba00813e9db16a0a)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:24.950791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:25.013092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f722be55e104ccfaea2d823f7bde98c'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.033101 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f722be55e104ccfaea2d823f7bde98c'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.034105 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f722be55e104ccfaea2d823f7bde98c'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.055105 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f722be55e104ccfaea2d823f7bde98c'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.056071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f722be55e104ccfaea2d823f7bde98c'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.065123 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1db124e7b94108ba00813e9db16a0a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.083951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 878/1719] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:24 2021] DELETE /identity/v3/users/5f722be55e104ccfaea2d823f7bde98c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:25.084905 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:25.085179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1db124e7b94108ba00813e9db16a0a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.087084 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1db124e7b94108ba00813e9db16a0a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.087981 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1db124e7b94108ba00813e9db16a0a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.089643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:25.104511 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-59a31ab9-9ed1-4438-a49e-e097bc9fc5eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1db124e7b94108ba00813e9db16a0a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.142791 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 842/1720] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:24 2021] DELETE /identity/v3/users/7c1db124e7b94108ba00813e9db16a0a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:25.144785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da3cbd-6fdc-487b-b036-41254337090b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:25.145177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da3cbd-6fdc-487b-b036-41254337090b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:25.145833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da3cbd-6fdc-487b-b036-41254337090b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:25.178261 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-69da3cbd-6fdc-487b-b036-41254337090b None None] MFA Rules not processed for user `6b2af9ab07d84fe18c8f231fd5741060`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:25.180619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-69da3cbd-6fdc-487b-b036-41254337090b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:25.273028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 843/1721] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:25 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:25.274778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2cd48-0cbe-4762-925d-c44cc54a87ad None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:25.275076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2cd48-0cbe-4762-925d-c44cc54a87ad None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:25.275355 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2cd48-0cbe-4762-925d-c44cc54a87ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:25.296647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46470366-c779-463b-9ace-d39d1a9f2682 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:25.296833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-25c2cd48-0cbe-4762-925d-c44cc54a87ad None None] MFA Rules not processed for user `ae3376227e8648fb9d2e46875db4b998`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:25.298071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-25c2cd48-0cbe-4762-925d-c44cc54a87ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:25.391674 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 844/1722] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:25 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:25.392533 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2cd48-0cbe-4762-925d-c44cc54a87ad None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:25.398527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-25c2cd48-0cbe-4762-925d-c44cc54a87ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:25.477482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30159a75-f523-4719-a74f-72f455b35375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:25.480072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30159a75-f523-4719-a74f-72f455b35375 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:25.480974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30159a75-f523-4719-a74f-72f455b35375 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:25.481916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30159a75-f523-4719-a74f-72f455b35375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:25.495687 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-30159a75-f523-4719-a74f-72f455b35375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:25.522993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30159a75-f523-4719-a74f-72f455b35375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:25.529185 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30159a75-f523-4719-a74f-72f455b35375 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:25.565130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 879/1723] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:25 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:25.566612 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ce64-d9dd-4e71-a4fa-bf8462255305 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:25.568055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ce64-d9dd-4e71-a4fa-bf8462255305 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:25.569592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ce64-d9dd-4e71-a4fa-bf8462255305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:25.584684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2cd48-0cbe-4762-925d-c44cc54a87ad None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:25.595956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f25283-2810-4898-8a77-ae3a60d22553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:25.599671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f25283-2810-4898-8a77-ae3a60d22553 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:25.600137 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f25283-2810-4898-8a77-ae3a60d22553 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:25.600672 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f25283-2810-4898-8a77-ae3a60d22553 admin admin] PATH_INFO: `/v3/projects/8d455c8fed9c406b8924d6b8c3c3dd97/users/6a854207efc34371b9487781b200ef12/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:25.621614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-65d3ce64-d9dd-4e71-a4fa-bf8462255305 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:25.622904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-65d3ce64-d9dd-4e71-a4fa-bf8462255305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:25.647571 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 880/1724] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:25.648532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f25283-2810-4898-8a77-ae3a60d22553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d455c8fed9c406b8924d6b8c3c3dd97, user_id=6a854207efc34371b9487781b200ef12, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:25.651096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ce64-d9dd-4e71-a4fa-bf8462255305 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:25.651633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f25283-2810-4898-8a77-ae3a60d22553 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:25.667929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-65d3ce64-d9dd-4e71-a4fa-bf8462255305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:25.690351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 845/1725] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:25 2021] PUT /identity/v3/projects/8d455c8fed9c406b8924d6b8c3c3dd97/users/6a854207efc34371b9487781b200ef12/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:25.704538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928ad37-7a14-4040-9d55-d81bc6ed5e54 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:25.704779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928ad37-7a14-4040-9d55-d81bc6ed5e54 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:25.705037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928ad37-7a14-4040-9d55-d81bc6ed5e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:25.716686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ce64-d9dd-4e71-a4fa-bf8462255305 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:25.762450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a928ad37-7a14-4040-9d55-d81bc6ed5e54 None None] MFA Rules not processed for user `6a854207efc34371b9487781b200ef12`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:25.768027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a928ad37-7a14-4040-9d55-d81bc6ed5e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:25.843522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:25.844755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:25.844755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:25.844992 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] PATH_INFO: `/v3/users/ddcf074fc4dc4e629cd8efa1f9c17b8d` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:25.852022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcf074fc4dc4e629cd8efa1f9c17b8d)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:25.854202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:25.925836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 846/1726] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:25 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:25.929820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928ad37-7a14-4040-9d55-d81bc6ed5e54 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:25.932537 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a928ad37-7a14-4040-9d55-d81bc6ed5e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:25.971278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcf074fc4dc4e629cd8efa1f9c17b8d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:25.999372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcf074fc4dc4e629cd8efa1f9c17b8d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:26.000376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcf074fc4dc4e629cd8efa1f9c17b8d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:26.015697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcf074fc4dc4e629cd8efa1f9c17b8d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:26.018823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcf074fc4dc4e629cd8efa1f9c17b8d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:26.058638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 881/1727] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:25 2021] DELETE /identity/v3/users/ddcf074fc4dc4e629cd8efa1f9c17b8d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:26.059978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:26.061764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:26.140130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928ad37-7a14-4040-9d55-d81bc6ed5e54 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:26.145927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e33003-94a8-4b01-8b3f-8a2c4c4b2b0b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:26.155565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba056ac-e2b0-480f-b37f-617499441f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:26.156758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba056ac-e2b0-480f-b37f-617499441f3e service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:26.157048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba056ac-e2b0-480f-b37f-617499441f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:26.157326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba056ac-e2b0-480f-b37f-617499441f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:26.164253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0ba056ac-e2b0-480f-b37f-617499441f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:26.282137 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049702e1-1900-4cc9-bcee-8df2a98d9e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:26.285246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049702e1-1900-4cc9-bcee-8df2a98d9e4b service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:26.285680 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049702e1-1900-4cc9-bcee-8df2a98d9e4b service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:26.285863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049702e1-1900-4cc9-bcee-8df2a98d9e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:26.293970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-049702e1-1900-4cc9-bcee-8df2a98d9e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:26.318019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba056ac-e2b0-480f-b37f-617499441f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:26.319522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba056ac-e2b0-480f-b37f-617499441f3e service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:26.347008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 882/1728] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:26.348740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba056ac-e2b0-480f-b37f-617499441f3e service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:26.353809 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0ba056ac-e2b0-480f-b37f-617499441f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:26.385577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba056ac-e2b0-480f-b37f-617499441f3e service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:26.392001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a1ad4-bfcb-4955-8286-52d8e9510077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:26.393072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a1ad4-bfcb-4955-8286-52d8e9510077 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:26.393761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a1ad4-bfcb-4955-8286-52d8e9510077 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:26.394254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a1ad4-bfcb-4955-8286-52d8e9510077 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:26.395520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a1ad4-bfcb-4955-8286-52d8e9510077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:26.397985 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a1ad4-bfcb-4955-8286-52d8e9510077 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:26.435645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 883/1729] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:26 2021] POST /identity/v3/projects => generated 357 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:26.436430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049702e1-1900-4cc9-bcee-8df2a98d9e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:26.437447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a32d-2ddf-492c-ab90-f8286e6830e5 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:26.437883 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a32d-2ddf-492c-ab90-f8286e6830e5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:26.438051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049702e1-1900-4cc9-bcee-8df2a98d9e4b service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:26.438449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a32d-2ddf-492c-ab90-f8286e6830e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:26.457275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 847/1730] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:25 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:26.458187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049702e1-1900-4cc9-bcee-8df2a98d9e4b service nova] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:26.459093 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7505a32d-2ddf-492c-ab90-f8286e6830e5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:26.460462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7505a32d-2ddf-492c-ab90-f8286e6830e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:26.486432 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049702e1-1900-4cc9-bcee-8df2a98d9e4b service nova] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:26.560019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 884/1731] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:26.562054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505a32d-2ddf-492c-ab90-f8286e6830e5 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:26.564598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7505a32d-2ddf-492c-ab90-f8286e6830e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:26.584037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505a32d-2ddf-492c-ab90-f8286e6830e5 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:26.590428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:26.591929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:26.592261 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:26.592549 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] PATH_INFO: `/v3/projects/3edb42873177479ba13ee8bee8db783b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:26.594880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edb42873177479ba13ee8bee8db783b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:26.597105 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:26.630408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60815-ffdc-4856-9796-05e79397b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:26.631675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60815-ffdc-4856-9796-05e79397b8ed admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:26.632964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60815-ffdc-4856-9796-05e79397b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:26.633390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60815-ffdc-4856-9796-05e79397b8ed admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:26.635017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa60815-ffdc-4856-9796-05e79397b8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:26.641733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa60815-ffdc-4856-9796-05e79397b8ed admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:26.697257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edb42873177479ba13ee8bee8db783b', 'request_id': 'req-147726c9-d3b8-4957-abfc-9b656db5e696'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:26.701273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 848/1732] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:26 2021] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:26.702275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60815-ffdc-4856-9796-05e79397b8ed admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:26.718651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edb42873177479ba13ee8bee8db783b', 'request_id': 'req-147726c9-d3b8-4957-abfc-9b656db5e696'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:26.738638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edb42873177479ba13ee8bee8db783b', 'request_id': 'req-147726c9-d3b8-4957-abfc-9b656db5e696'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:26.766968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] The token cache is being invalidate because project 3edb42873177479ba13ee8bee8db783b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:26.769053 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:26.770952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:26.774477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 885/1733] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:26 2021] DELETE /identity/v3/projects/3edb42873177479ba13ee8bee8db783b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:26.779151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:26.783696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:26.827100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60815-ffdc-4856-9796-05e79397b8ed admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:26.907179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f2b85-23f4-4faa-ae46-b823061477c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:26.909233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2b85-23f4-4faa-ae46-b823061477c3 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:26.912097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2b85-23f4-4faa-ae46-b823061477c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:26.912871 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2b85-23f4-4faa-ae46-b823061477c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:26.918111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-293f2b85-23f4-4faa-ae46-b823061477c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:26.947058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147726c9-d3b8-4957-abfc-9b656db5e696 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:26.948166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f2b85-23f4-4faa-ae46-b823061477c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:26.949762 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f2b85-23f4-4faa-ae46-b823061477c3 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:26.967350 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527392-9985-4ea9-b705-5a2a84778b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:26.968100 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527392-9985-4ea9-b705-5a2a84778b4f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:26.968428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527392-9985-4ea9-b705-5a2a84778b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:26.968708 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527392-9985-4ea9-b705-5a2a84778b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:26.969436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0527392-9985-4ea9-b705-5a2a84778b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:26.973810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0527392-9985-4ea9-b705-5a2a84778b4f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:26.977773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 849/1734] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:26.979197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbec94-496e-4493-a25c-fa306cc6dd65 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:26.979481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbec94-496e-4493-a25c-fa306cc6dd65 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:26.979754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbec94-496e-4493-a25c-fa306cc6dd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.006391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 886/1735] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:26 2021] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:27.009063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527392-9985-4ea9-b705-5a2a84778b4f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.023592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-34dbec94-496e-4493-a25c-fa306cc6dd65 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:27.024818 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-34dbec94-496e-4493-a25c-fa306cc6dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:27.033477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527392-9985-4ea9-b705-5a2a84778b4f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.037242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 850/1736] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:27.045302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4d1e3-8b87-4eb2-a4e8-63d27a1ee2a6 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.046041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812a79f-19a2-4c82-9e68-7e225838936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.047239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812a79f-19a2-4c82-9e68-7e225838936c admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.047623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4d1e3-8b87-4eb2-a4e8-63d27a1ee2a6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.048020 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812a79f-19a2-4c82-9e68-7e225838936c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.048387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4d1e3-8b87-4eb2-a4e8-63d27a1ee2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.048767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812a79f-19a2-4c82-9e68-7e225838936c admin admin] PATH_INFO: `/v3/projects/690f607976694173a7b0f365fbe9655a/users/833f72beb1af47dfa3bec2e22f2fff55/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.080677 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d2a4d1e3-8b87-4eb2-a4e8-63d27a1ee2a6 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:27.082066 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d2a4d1e3-8b87-4eb2-a4e8-63d27a1ee2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:27.088713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812a79f-19a2-4c82-9e68-7e225838936c admin admin] RBAC: Authorizing `identity:create_grant(project_id=690f607976694173a7b0f365fbe9655a, user_id=833f72beb1af47dfa3bec2e22f2fff55, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.095647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812a79f-19a2-4c82-9e68-7e225838936c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.101358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 851/1737] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:27.102887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4d1e3-8b87-4eb2-a4e8-63d27a1ee2a6 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.117062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4d1e3-8b87-4eb2-a4e8-63d27a1ee2a6 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.122300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 887/1738] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:27 2021] PUT /identity/v3/projects/690f607976694173a7b0f365fbe9655a/users/833f72beb1af47dfa3bec2e22f2fff55/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:27.128290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812a79f-19a2-4c82-9e68-7e225838936c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.211950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77f66f-d23c-4eae-9a33-607ce2a26fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.212735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77f66f-d23c-4eae-9a33-607ce2a26fbd admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.213114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77f66f-d23c-4eae-9a33-607ce2a26fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.213488 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77f66f-d23c-4eae-9a33-607ce2a26fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.214508 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77f66f-d23c-4eae-9a33-607ce2a26fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:27.214945 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77f66f-d23c-4eae-9a33-607ce2a26fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.216827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77f66f-d23c-4eae-9a33-607ce2a26fbd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.221481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812a79f-19a2-4c82-9e68-7e225838936c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.227946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0ae90-b4bd-49f5-9110-9ed0f07fe8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.228139 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0ae90-b4bd-49f5-9110-9ed0f07fe8ef admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.228427 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0ae90-b4bd-49f5-9110-9ed0f07fe8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.229031 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0ae90-b4bd-49f5-9110-9ed0f07fe8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.229637 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0ae90-b4bd-49f5-9110-9ed0f07fe8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.231888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0ae90-b4bd-49f5-9110-9ed0f07fe8ef admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.236299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 852/1739] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:27.241346 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77f66f-d23c-4eae-9a33-607ce2a26fbd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.248563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 888/1740] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:27 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:27.249725 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0ae90-b4bd-49f5-9110-9ed0f07fe8ef admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.262955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0ae90-b4bd-49f5-9110-9ed0f07fe8ef admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.265439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77f66f-d23c-4eae-9a33-607ce2a26fbd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.274617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dd9cb-9dbd-4cdb-bb80-197d4094a9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.275917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dd9cb-9dbd-4cdb-bb80-197d4094a9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.276203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dd9cb-9dbd-4cdb-bb80-197d4094a9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.276482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dd9cb-9dbd-4cdb-bb80-197d4094a9a8 admin admin] PATH_INFO: `/v3/projects/690f607976694173a7b0f365fbe9655a/users/833f72beb1af47dfa3bec2e22f2fff55/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.280017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06204d2-4bdb-4fea-b9c3-71b90e46b27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.280961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06204d2-4bdb-4fea-b9c3-71b90e46b27b admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.281622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06204d2-4bdb-4fea-b9c3-71b90e46b27b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.282124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06204d2-4bdb-4fea-b9c3-71b90e46b27b admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.283086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06204d2-4bdb-4fea-b9c3-71b90e46b27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.293069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06204d2-4bdb-4fea-b9c3-71b90e46b27b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.293238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dd9cb-9dbd-4cdb-bb80-197d4094a9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690f607976694173a7b0f365fbe9655a, user_id=833f72beb1af47dfa3bec2e22f2fff55, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.296166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dd9cb-9dbd-4cdb-bb80-197d4094a9a8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.340558 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 889/1741] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:27 2021] PUT /identity/v3/projects/690f607976694173a7b0f365fbe9655a/users/833f72beb1af47dfa3bec2e22f2fff55/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:27.346134 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5f12e-9936-48a5-8fb7-21857927684c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.346739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5f12e-9936-48a5-8fb7-21857927684c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.347208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5f12e-9936-48a5-8fb7-21857927684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.350460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 853/1742] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:27 2021] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:27.351598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06204d2-4bdb-4fea-b9c3-71b90e46b27b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.382785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-eef5f12e-9936-48a5-8fb7-21857927684c None None] MFA Rules not processed for user `833f72beb1af47dfa3bec2e22f2fff55`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:27.384848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-eef5f12e-9936-48a5-8fb7-21857927684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:27.477032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06204d2-4bdb-4fea-b9c3-71b90e46b27b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.495617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19a106-5531-45a6-adaa-b81e54969cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.496696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19a106-5531-45a6-adaa-b81e54969cdd admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.497118 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19a106-5531-45a6-adaa-b81e54969cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.497634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19a106-5531-45a6-adaa-b81e54969cdd admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.498506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19a106-5531-45a6-adaa-b81e54969cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.500755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19a106-5531-45a6-adaa-b81e54969cdd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.514722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 890/1743] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:27 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:27.523372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5f12e-9936-48a5-8fb7-21857927684c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.524353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-eef5f12e-9936-48a5-8fb7-21857927684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:27.531137 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 854/1744] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:27 2021] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:27.535111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19a106-5531-45a6-adaa-b81e54969cdd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.549604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19a106-5531-45a6-adaa-b81e54969cdd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.556708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5f362-2ca7-4c0c-a005-e3f3fa0cd084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.557695 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5f362-2ca7-4c0c-a005-e3f3fa0cd084 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.557986 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5f362-2ca7-4c0c-a005-e3f3fa0cd084 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.558460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5f362-2ca7-4c0c-a005-e3f3fa0cd084 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.560160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5f362-2ca7-4c0c-a005-e3f3fa0cd084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.561802 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5f362-2ca7-4c0c-a005-e3f3fa0cd084 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.577281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 855/1745] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:27 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:27.581660 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5f362-2ca7-4c0c-a005-e3f3fa0cd084 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.594464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5f362-2ca7-4c0c-a005-e3f3fa0cd084 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.600004 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391b096-45a2-4004-ab0a-a63fb9bf3f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.601089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391b096-45a2-4004-ab0a-a63fb9bf3f53 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.601443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391b096-45a2-4004-ab0a-a63fb9bf3f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.601792 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391b096-45a2-4004-ab0a-a63fb9bf3f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.602591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391b096-45a2-4004-ab0a-a63fb9bf3f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.604953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391b096-45a2-4004-ab0a-a63fb9bf3f53 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.605936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5f12e-9936-48a5-8fb7-21857927684c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.610388 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87b4f9-817e-436d-bcbc-a1337fd0b442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.611413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87b4f9-817e-436d-bcbc-a1337fd0b442 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.611895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87b4f9-817e-436d-bcbc-a1337fd0b442 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.612360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87b4f9-817e-436d-bcbc-a1337fd0b442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.621399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 856/1746] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:27 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:27.624284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87b4f9-817e-436d-bcbc-a1337fd0b442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.626102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87b4f9-817e-436d-bcbc-a1337fd0b442 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.627462 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391b096-45a2-4004-ab0a-a63fb9bf3f53 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.645360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 891/1747] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:27 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:27.648882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391b096-45a2-4004-ab0a-a63fb9bf3f53 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.658902 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87d9ca-37c2-43a3-847c-0cf1c03f9960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.659834 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87d9ca-37c2-43a3-847c-0cf1c03f9960 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.660121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87d9ca-37c2-43a3-847c-0cf1c03f9960 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.660405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87d9ca-37c2-43a3-847c-0cf1c03f9960 admin admin] PATH_INFO: `/v3/projects/7402c0c6a4b747aeb4ecd71854b2c7e8/users/aedef19e6dbc497497b33afbbbe0e200/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.679202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87d9ca-37c2-43a3-847c-0cf1c03f9960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7402c0c6a4b747aeb4ecd71854b2c7e8, user_id=aedef19e6dbc497497b33afbbbe0e200, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.682445 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87d9ca-37c2-43a3-847c-0cf1c03f9960 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.714199 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 857/1748] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:27 2021] PUT /identity/v3/projects/7402c0c6a4b747aeb4ecd71854b2c7e8/users/aedef19e6dbc497497b33afbbbe0e200/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:27.716795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438541d9-f8af-4803-85ef-184f6e5bbe2c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.719377 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438541d9-f8af-4803-85ef-184f6e5bbe2c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.719664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438541d9-f8af-4803-85ef-184f6e5bbe2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.758013 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-438541d9-f8af-4803-85ef-184f6e5bbe2c None None] MFA Rules not processed for user `aedef19e6dbc497497b33afbbbe0e200`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:27.761169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-438541d9-f8af-4803-85ef-184f6e5bbe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:27.771605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87d9ca-37c2-43a3-847c-0cf1c03f9960 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.862403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87d9ca-37c2-43a3-847c-0cf1c03f9960 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:27.871493 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6b94d-8c3d-4445-b89d-169038a266bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:27.873876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6b94d-8c3d-4445-b89d-169038a266bd service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:27.874616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6b94d-8c3d-4445-b89d-169038a266bd service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:27.874616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6b94d-8c3d-4445-b89d-169038a266bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:27.878856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b3f6b94d-8c3d-4445-b89d-169038a266bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:27.881027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 892/1749] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:27 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:27.885674 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438541d9-f8af-4803-85ef-184f6e5bbe2c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:27.979479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6b94d-8c3d-4445-b89d-169038a266bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:27.981205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6b94d-8c3d-4445-b89d-169038a266bd service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:27.993275 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438541d9-f8af-4803-85ef-184f6e5bbe2c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:28.000138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf696c-3411-4b6d-b5c2-8ef19072685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:28.000504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf696c-3411-4b6d-b5c2-8ef19072685b admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:28.000800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf696c-3411-4b6d-b5c2-8ef19072685b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:28.001082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf696c-3411-4b6d-b5c2-8ef19072685b admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:28.001784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf696c-3411-4b6d-b5c2-8ef19072685b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:28.004241 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf696c-3411-4b6d-b5c2-8ef19072685b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:28.011056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 858/1750] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:27 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:28.068367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 893/1751] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:27 2021] POST /identity/v3/projects => generated 401 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:28.069992 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6b94d-8c3d-4445-b89d-169038a266bd service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:28.089855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6b94d-8c3d-4445-b89d-169038a266bd service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:28.194489 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7b40b-8837-4469-96ef-def91cc95152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:28.195562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7b40b-8837-4469-96ef-def91cc95152 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:28.196126 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7b40b-8837-4469-96ef-def91cc95152 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:28.196607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7b40b-8837-4469-96ef-def91cc95152 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:28.197533 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7b40b-8837-4469-96ef-def91cc95152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:28.199942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7b40b-8837-4469-96ef-def91cc95152 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:28.247264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf696c-3411-4b6d-b5c2-8ef19072685b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:28.249659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 859/1752] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:28 2021] POST /identity/v3/users => generated 307 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:28.264455 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf696c-3411-4b6d-b5c2-8ef19072685b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:28.270871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9a766-4230-4378-80d7-0e1ae2258802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:28.275094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9a766-4230-4378-80d7-0e1ae2258802 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:28.275524 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9a766-4230-4378-80d7-0e1ae2258802 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:28.276004 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9a766-4230-4378-80d7-0e1ae2258802 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:28.277735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9a766-4230-4378-80d7-0e1ae2258802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:28.279864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9a766-4230-4378-80d7-0e1ae2258802 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:28.314335 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 894/1753] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:28 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:28.322753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7b40b-8837-4469-96ef-def91cc95152 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:28.335702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7b40b-8837-4469-96ef-def91cc95152 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:28.342370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d6d0-fd1f-4860-91ed-9470000b524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:28.343534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d6d0-fd1f-4860-91ed-9470000b524e admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:28.344154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d6d0-fd1f-4860-91ed-9470000b524e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:28.344154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d6d0-fd1f-4860-91ed-9470000b524e admin admin] PATH_INFO: `/v3/projects/5d157ea172484660ad2c4c6e9421106f/users/13b62e498af94276abaa4e9c9a301d26/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:28.362145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05d6d0-fd1f-4860-91ed-9470000b524e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d157ea172484660ad2c4c6e9421106f, user_id=13b62e498af94276abaa4e9c9a301d26, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:28.365226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05d6d0-fd1f-4860-91ed-9470000b524e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:28.388668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 860/1754] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:28 2021] PUT /identity/v3/projects/5d157ea172484660ad2c4c6e9421106f/users/13b62e498af94276abaa4e9c9a301d26/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:28.393109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9a766-4230-4378-80d7-0e1ae2258802 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:28.410095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9a766-4230-4378-80d7-0e1ae2258802 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:28.467867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d6d0-fd1f-4860-91ed-9470000b524e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:28.469859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-cf05d6d0-fd1f-4860-91ed-9470000b524e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:28.594194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d94c1-1f0e-464e-b98a-54532a1fc4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:28.596553 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d94c1-1f0e-464e-b98a-54532a1fc4ff admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:28.597268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d94c1-1f0e-464e-b98a-54532a1fc4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:28.597768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d94c1-1f0e-464e-b98a-54532a1fc4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:28.598791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d94c1-1f0e-464e-b98a-54532a1fc4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:28.601204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d94c1-1f0e-464e-b98a-54532a1fc4ff admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:28.615708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d6d0-fd1f-4860-91ed-9470000b524e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:28.624432 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:28.625661 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:28.626060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:28.626434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] PATH_INFO: `/v3/projects/15a57f36ec0f4114a83a0a467e571447` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:28.627856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a57f36ec0f4114a83a0a467e571447)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:28.631023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:28.633163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 895/1755] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:28 2021] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:28.635181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d94c1-1f0e-464e-b98a-54532a1fc4ff admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:28.667242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d94c1-1f0e-464e-b98a-54532a1fc4ff admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:28.696682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa5c35-86ec-494e-a514-899c921ec259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:28.698212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa5c35-86ec-494e-a514-899c921ec259 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:28.705258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa5c35-86ec-494e-a514-899c921ec259 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:28.709739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa5c35-86ec-494e-a514-899c921ec259 admin admin] PATH_INFO: `/v3/projects/5d157ea172484660ad2c4c6e9421106f/users/13b62e498af94276abaa4e9c9a301d26/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:28.716175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa5c35-86ec-494e-a514-899c921ec259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d157ea172484660ad2c4c6e9421106f, user_id=13b62e498af94276abaa4e9c9a301d26, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:28.723725 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa5c35-86ec-494e-a514-899c921ec259 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:28.729877 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a57f36ec0f4114a83a0a467e571447', 'request_id': 'req-97c499e3-e505-4791-864e-b164819ec111'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:28.757517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 896/1756] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:28 2021] PUT /identity/v3/projects/5d157ea172484660ad2c4c6e9421106f/users/13b62e498af94276abaa4e9c9a301d26/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:28.767856 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e039-a5fa-4c38-adcf-760a60e843aa None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:28.768886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a57f36ec0f4114a83a0a467e571447', 'request_id': 'req-97c499e3-e505-4791-864e-b164819ec111'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:28.771364 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e039-a5fa-4c38-adcf-760a60e843aa None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:28.771861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e039-a5fa-4c38-adcf-760a60e843aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:28.787271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a57f36ec0f4114a83a0a467e571447', 'request_id': 'req-97c499e3-e505-4791-864e-b164819ec111'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:28.808258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] The token cache is being invalidate because project 15a57f36ec0f4114a83a0a467e571447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:28.809112 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:28.810543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:28.818119 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 861/1757] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:28 2021] DELETE /identity/v3/projects/15a57f36ec0f4114a83a0a467e571447 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:28.819472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:28.821216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:28.838248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2a99e039-a5fa-4c38-adcf-760a60e843aa None None] MFA Rules not processed for user `13b62e498af94276abaa4e9c9a301d26`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:28.842025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2a99e039-a5fa-4c38-adcf-760a60e843aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:29.005675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c499e3-e505-4791-864e-b164819ec111 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:29.032029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 897/1758] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:28 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:29.034995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af665f1-bdb9-47fe-acfe-6c4c817a4a0e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:29.035574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af665f1-bdb9-47fe-acfe-6c4c817a4a0e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:29.036144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af665f1-bdb9-47fe-acfe-6c4c817a4a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:29.073200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-3af665f1-bdb9-47fe-acfe-6c4c817a4a0e None None] MFA Rules not processed for user `ae3376227e8648fb9d2e46875db4b998`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:29.076285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3af665f1-bdb9-47fe-acfe-6c4c817a4a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:29.139458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:29.140474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:29.140691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:29.144930 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] PATH_INFO: `/v3/users/5a8d4780e576447fbdef126dff6ee709` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:29.147807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8d4780e576447fbdef126dff6ee709)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:29.152138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:29.170754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 898/1759] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:29 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:29.170754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af665f1-bdb9-47fe-acfe-6c4c817a4a0e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:29.172429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3af665f1-bdb9-47fe-acfe-6c4c817a4a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:29.251350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8d4780e576447fbdef126dff6ee709'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:29.265440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8d4780e576447fbdef126dff6ee709'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:29.266226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8d4780e576447fbdef126dff6ee709'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:29.266937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8d4780e576447fbdef126dff6ee709'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:29.292250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8d4780e576447fbdef126dff6ee709'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:29.296211 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af665f1-bdb9-47fe-acfe-6c4c817a4a0e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:29.301076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644d9bd-0f76-469b-8dae-128cbfda902e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:29.303192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644d9bd-0f76-469b-8dae-128cbfda902e service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:29.303714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644d9bd-0f76-469b-8dae-128cbfda902e service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:29.304161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644d9bd-0f76-469b-8dae-128cbfda902e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:29.307436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1644d9bd-0f76-469b-8dae-128cbfda902e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:29.329341 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644d9bd-0f76-469b-8dae-128cbfda902e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:29.331529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644d9bd-0f76-469b-8dae-128cbfda902e service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:29.335698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 862/1760] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:28 2021] DELETE /identity/v3/users/5a8d4780e576447fbdef126dff6ee709 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:29.337014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:29.341416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:29.367445 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 899/1761] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:29 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:29.486933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0bded-11fa-4344-b9ab-1a066e3ef6f8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:29.494723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:29.496232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:29.496658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:29.497138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] PATH_INFO: `/v3/projects/ab15ba44fef84cc9a082325c03f8eaa3` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:29.499162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab15ba44fef84cc9a082325c03f8eaa3)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:29.504899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:29.527776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644d9bd-0f76-469b-8dae-128cbfda902e service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:29.529195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1644d9bd-0f76-469b-8dae-128cbfda902e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:29.546931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644d9bd-0f76-469b-8dae-128cbfda902e service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:29.614289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab15ba44fef84cc9a082325c03f8eaa3', 'request_id': 'req-592aa35c-ea46-47b8-89ef-389d866225dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:29.639669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab15ba44fef84cc9a082325c03f8eaa3', 'request_id': 'req-592aa35c-ea46-47b8-89ef-389d866225dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:29.657733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab15ba44fef84cc9a082325c03f8eaa3', 'request_id': 'req-592aa35c-ea46-47b8-89ef-389d866225dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:29.679479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] The token cache is being invalidate because project ab15ba44fef84cc9a082325c03f8eaa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:29.679904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:29.680880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:29.684261 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 863/1762] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:29 2021] DELETE /identity/v3/projects/ab15ba44fef84cc9a082325c03f8eaa3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:29.688043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:29.691831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:29.746649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb2baf-5a00-484f-a937-3befec2381c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:29.747460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2baf-5a00-484f-a937-3befec2381c0 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:29.748129 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2baf-5a00-484f-a937-3befec2381c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:29.749309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2baf-5a00-484f-a937-3befec2381c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:29.753994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3efb2baf-5a00-484f-a937-3befec2381c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:29.849742 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592aa35c-ea46-47b8-89ef-389d866225dc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:29.855707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:29.856592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:29.856873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:29.857141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] PATH_INFO: `/v3/users/6b2af9ab07d84fe18c8f231fd5741060` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:29.858481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2af9ab07d84fe18c8f231fd5741060)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:29.860698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:29.924598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb2baf-5a00-484f-a937-3befec2381c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:29.926577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb2baf-5a00-484f-a937-3befec2381c0 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:29.949380 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 900/1763] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:29 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:29.964629 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb2baf-5a00-484f-a937-3befec2381c0 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:29.977413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3efb2baf-5a00-484f-a937-3befec2381c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:30.009134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2af9ab07d84fe18c8f231fd5741060'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.035171 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb2baf-5a00-484f-a937-3befec2381c0 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:30.043427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2af9ab07d84fe18c8f231fd5741060'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.044185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2af9ab07d84fe18c8f231fd5741060'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.045177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2af9ab07d84fe18c8f231fd5741060'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.049874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:30.050973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:30.051308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:30.051587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] PATH_INFO: `/v3/projects/1f19b87847ed4b4da680bf6bcb51c860` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:30.054110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f19b87847ed4b4da680bf6bcb51c860)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:30.069048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:30.072039 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c12f494d-1f4b-4a7d-8918-1bcfcc2cde15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2af9ab07d84fe18c8f231fd5741060'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.127076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 864/1764] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:29 2021] DELETE /identity/v3/users/6b2af9ab07d84fe18c8f231fd5741060 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:30.190628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f19b87847ed4b4da680bf6bcb51c860', 'request_id': 'req-4f43f63b-6008-4923-a5cf-4874119347ad'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.204948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f19b87847ed4b4da680bf6bcb51c860', 'request_id': 'req-4f43f63b-6008-4923-a5cf-4874119347ad'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.222774 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f19b87847ed4b4da680bf6bcb51c860', 'request_id': 'req-4f43f63b-6008-4923-a5cf-4874119347ad'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.248144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] The token cache is being invalidate because project 1f19b87847ed4b4da680bf6bcb51c860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:30.248747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.251063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4f43f63b-6008-4923-a5cf-4874119347ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.259110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 901/1765] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:29 2021] DELETE /identity/v3/projects/1f19b87847ed4b4da680bf6bcb51c860 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:30.261775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93550a6-00a4-415e-9a79-82bd8501a5e0 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:30.262331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93550a6-00a4-415e-9a79-82bd8501a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:30.262914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93550a6-00a4-415e-9a79-82bd8501a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:30.304694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d93550a6-00a4-415e-9a79-82bd8501a5e0 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:30.307993 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d93550a6-00a4-415e-9a79-82bd8501a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:30.440244 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 865/1766] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:30.443004 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ef261-327f-4d56-8b4e-76cef0240946 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:30.443502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ef261-327f-4d56-8b4e-76cef0240946 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:30.444975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ef261-327f-4d56-8b4e-76cef0240946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:30.483201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-273ef261-327f-4d56-8b4e-76cef0240946 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:30.484695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-273ef261-327f-4d56-8b4e-76cef0240946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:30.500464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93550a6-00a4-415e-9a79-82bd8501a5e0 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:30.507931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 902/1767] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:30.512338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93550a6-00a4-415e-9a79-82bd8501a5e0 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:30.518142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fcc20-09ac-4561-9002-07827d2f8e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:30.518522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fcc20-09ac-4561-9002-07827d2f8e95 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:30.518999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fcc20-09ac-4561-9002-07827d2f8e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:30.519600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fcc20-09ac-4561-9002-07827d2f8e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:30.520465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fcc20-09ac-4561-9002-07827d2f8e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:30.520952 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fcc20-09ac-4561-9002-07827d2f8e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:30.523051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fcc20-09ac-4561-9002-07827d2f8e95 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:30.549170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ef261-327f-4d56-8b4e-76cef0240946 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:30.559458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ef261-327f-4d56-8b4e-76cef0240946 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:30.562893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 866/1768] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:30.591428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec39b0-a8db-4b7d-bb35-3b0c8878f85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:30.592295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec39b0-a8db-4b7d-bb35-3b0c8878f85c admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:30.596271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec39b0-a8db-4b7d-bb35-3b0c8878f85c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:30.596712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec39b0-a8db-4b7d-bb35-3b0c8878f85c admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:30.597888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec39b0-a8db-4b7d-bb35-3b0c8878f85c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:30.600182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec39b0-a8db-4b7d-bb35-3b0c8878f85c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:30.651633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 903/1769] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:30 2021] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:30.652993 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fcc20-09ac-4561-9002-07827d2f8e95 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:30.667983 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fcc20-09ac-4561-9002-07827d2f8e95 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:30.680757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec39b0-a8db-4b7d-bb35-3b0c8878f85c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:30.684024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-19ec39b0-a8db-4b7d-bb35-3b0c8878f85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:30.767456 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7e084-99a8-4f54-97cc-3a8671c58a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:30.768484 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e084-99a8-4f54-97cc-3a8671c58a3b admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:30.768871 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e084-99a8-4f54-97cc-3a8671c58a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:30.769250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e084-99a8-4f54-97cc-3a8671c58a3b admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:30.770331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7e084-99a8-4f54-97cc-3a8671c58a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:30.772753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7e084-99a8-4f54-97cc-3a8671c58a3b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:30.787172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec39b0-a8db-4b7d-bb35-3b0c8878f85c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:30.793574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:30.794450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:30.794770 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:30.795049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] PATH_INFO: `/v3/projects/a8a1524165b1463da5dcac318ab36ec5` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:30.796626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a1524165b1463da5dcac318ab36ec5)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:30.799787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:30.810925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 867/1770] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:30 2021] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:30.813522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7e084-99a8-4f54-97cc-3a8671c58a3b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:30.836535 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7e084-99a8-4f54-97cc-3a8671c58a3b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:30.844058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525959b-c481-4ecf-bc7d-0400ffd85d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:30.844804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525959b-c481-4ecf-bc7d-0400ffd85d6f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:30.846095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525959b-c481-4ecf-bc7d-0400ffd85d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:30.846229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525959b-c481-4ecf-bc7d-0400ffd85d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:30.847333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525959b-c481-4ecf-bc7d-0400ffd85d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:30.850151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525959b-c481-4ecf-bc7d-0400ffd85d6f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:30.865595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 868/1771] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:30 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:30.869199 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525959b-c481-4ecf-bc7d-0400ffd85d6f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:30.878643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a1524165b1463da5dcac318ab36ec5', 'request_id': 'req-aabc34b2-d0ee-4383-9748-9489fcaad125'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.885868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a1524165b1463da5dcac318ab36ec5', 'request_id': 'req-aabc34b2-d0ee-4383-9748-9489fcaad125'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.890153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525959b-c481-4ecf-bc7d-0400ffd85d6f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:30.892361 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a1524165b1463da5dcac318ab36ec5', 'request_id': 'req-aabc34b2-d0ee-4383-9748-9489fcaad125'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.920299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] The token cache is being invalidate because project a8a1524165b1463da5dcac318ab36ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:30.922360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.924442 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-aabc34b2-d0ee-4383-9748-9489fcaad125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:30.928439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 904/1772] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:30 2021] DELETE /identity/v3/projects/a8a1524165b1463da5dcac318ab36ec5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:30.934358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f5d07-8a6b-4fbf-81cc-05827bda5266 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:30.934806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f5d07-8a6b-4fbf-81cc-05827bda5266 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:30.935331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f5d07-8a6b-4fbf-81cc-05827bda5266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:30.976874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-dd0f5d07-8a6b-4fbf-81cc-05827bda5266 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:30.981437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-dd0f5d07-8a6b-4fbf-81cc-05827bda5266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:30.986749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9b7ba-7909-4d49-87dd-155814b4a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:30.987469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9b7ba-7909-4d49-87dd-155814b4a630 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:30.987758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9b7ba-7909-4d49-87dd-155814b4a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:30.988033 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9b7ba-7909-4d49-87dd-155814b4a630 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:30.989760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9b7ba-7909-4d49-87dd-155814b4a630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:30.991630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9b7ba-7909-4d49-87dd-155814b4a630 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.010827 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 905/1773] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:31.011166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 869/1774] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:30 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:31.011258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f5d07-8a6b-4fbf-81cc-05827bda5266 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.012380 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-dd0f5d07-8a6b-4fbf-81cc-05827bda5266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:31.012819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1fb0-bbf6-4c85-9278-0ea5d1222625 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.013228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1fb0-bbf6-4c85-9278-0ea5d1222625 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.013505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1fb0-bbf6-4c85-9278-0ea5d1222625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.033829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d7da1fb0-bbf6-4c85-9278-0ea5d1222625 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:31.035237 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d7da1fb0-bbf6-4c85-9278-0ea5d1222625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:31.037426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f5d07-8a6b-4fbf-81cc-05827bda5266 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.048793 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 870/1775] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:31.049250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc023f7-b1bb-4b49-ab0b-502010ea0fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.049817 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da1fb0-bbf6-4c85-9278-0ea5d1222625 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.050392 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc023f7-b1bb-4b49-ab0b-502010ea0fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.050886 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc023f7-b1bb-4b49-ab0b-502010ea0fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.051907 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc023f7-b1bb-4b49-ab0b-502010ea0fe2 admin admin] PATH_INFO: `/v3/projects/807383147ea94d66a37d2df4dba0ae01/users/b44dcf0b336b472bac8beb366029a348/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.060412 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da1fb0-bbf6-4c85-9278-0ea5d1222625 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.066536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcd393-2885-402a-ac15-32ab7a974c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.069358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcd393-2885-402a-ac15-32ab7a974c5c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.069694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcd393-2885-402a-ac15-32ab7a974c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.070051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcd393-2885-402a-ac15-32ab7a974c5c admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.072091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcd393-2885-402a-ac15-32ab7a974c5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:31.072091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcd393-2885-402a-ac15-32ab7a974c5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.074138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcd393-2885-402a-ac15-32ab7a974c5c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.084433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc023f7-b1bb-4b49-ab0b-502010ea0fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807383147ea94d66a37d2df4dba0ae01, user_id=b44dcf0b336b472bac8beb366029a348, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.087625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc023f7-b1bb-4b49-ab0b-502010ea0fe2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.090711 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 871/1776] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:31.093755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcd393-2885-402a-ac15-32ab7a974c5c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.111759 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcd393-2885-402a-ac15-32ab7a974c5c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.123739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 906/1777] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:31 2021] PUT /identity/v3/projects/807383147ea94d66a37d2df4dba0ae01/users/b44dcf0b336b472bac8beb366029a348/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:31.127301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e097f62-68eb-477d-9c5b-7f69291e357e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.127719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e097f62-68eb-477d-9c5b-7f69291e357e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.128557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e097f62-68eb-477d-9c5b-7f69291e357e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.180525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-4e097f62-68eb-477d-9c5b-7f69291e357e None None] MFA Rules not processed for user `b44dcf0b336b472bac8beb366029a348`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:31.181998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4e097f62-68eb-477d-9c5b-7f69291e357e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:31.274501 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2f84-b6db-4308-8a73-a3d7e9abab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.275192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2f84-b6db-4308-8a73-a3d7e9abab16 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.275417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2f84-b6db-4308-8a73-a3d7e9abab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.275772 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2f84-b6db-4308-8a73-a3d7e9abab16 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.276698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2f84-b6db-4308-8a73-a3d7e9abab16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.278949 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2f84-b6db-4308-8a73-a3d7e9abab16 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.317748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 907/1778] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:31 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:31.323028 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e097f62-68eb-477d-9c5b-7f69291e357e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.343784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 872/1779] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:31 2021] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:31.346057 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e097f62-68eb-477d-9c5b-7f69291e357e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.346910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2f84-b6db-4308-8a73-a3d7e9abab16 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.481456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf7bb4-3aea-42ba-8a60-5fc1b73cf201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.482801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7bb4-3aea-42ba-8a60-5fc1b73cf201 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.483168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7bb4-3aea-42ba-8a60-5fc1b73cf201 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.486529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf7bb4-3aea-42ba-8a60-5fc1b73cf201 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.486529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf7bb4-3aea-42ba-8a60-5fc1b73cf201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.486529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf7bb4-3aea-42ba-8a60-5fc1b73cf201 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.542342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2f84-b6db-4308-8a73-a3d7e9abab16 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.551340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 908/1780] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:31 2021] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:31.552647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf7bb4-3aea-42ba-8a60-5fc1b73cf201 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.664177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf7bb4-3aea-42ba-8a60-5fc1b73cf201 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.677855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282a8dd-2bc2-483f-9a53-6199bad3b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.680102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282a8dd-2bc2-483f-9a53-6199bad3b3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.680394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282a8dd-2bc2-483f-9a53-6199bad3b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.682098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282a8dd-2bc2-483f-9a53-6199bad3b3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.683276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282a8dd-2bc2-483f-9a53-6199bad3b3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.688665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282a8dd-2bc2-483f-9a53-6199bad3b3a0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.733707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e37c1-13a7-47f3-899f-5890ae6f8855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.737425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e37c1-13a7-47f3-899f-5890ae6f8855 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.738038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e37c1-13a7-47f3-899f-5890ae6f8855 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.739408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e37c1-13a7-47f3-899f-5890ae6f8855 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.741406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e37c1-13a7-47f3-899f-5890ae6f8855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.746298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 909/1781] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:31 2021] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:31.749229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e37c1-13a7-47f3-899f-5890ae6f8855 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.750158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282a8dd-2bc2-483f-9a53-6199bad3b3a0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.772963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282a8dd-2bc2-483f-9a53-6199bad3b3a0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.778419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c2ba0-5ab8-4822-9d4a-b1a0f2fda62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.779430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c2ba0-5ab8-4822-9d4a-b1a0f2fda62c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.779430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c2ba0-5ab8-4822-9d4a-b1a0f2fda62c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.779647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c2ba0-5ab8-4822-9d4a-b1a0f2fda62c admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.780728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c2ba0-5ab8-4822-9d4a-b1a0f2fda62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.782023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c2ba0-5ab8-4822-9d4a-b1a0f2fda62c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.804928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 910/1782] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:31 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:31.811508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c2ba0-5ab8-4822-9d4a-b1a0f2fda62c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.813738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 873/1783] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:31 2021] POST /identity/v3/users => generated 287 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:31.816227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e37c1-13a7-47f3-899f-5890ae6f8855 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.842008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c2ba0-5ab8-4822-9d4a-b1a0f2fda62c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.851409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e37c1-13a7-47f3-899f-5890ae6f8855 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.854192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb314d-fc68-4d0f-9602-81c74a462511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.855046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb314d-fc68-4d0f-9602-81c74a462511 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.855563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb314d-fc68-4d0f-9602-81c74a462511 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.856021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb314d-fc68-4d0f-9602-81c74a462511 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.856764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb314d-fc68-4d0f-9602-81c74a462511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.858440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb314d-fc68-4d0f-9602-81c74a462511 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.863401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e007df8-517b-41b0-969b-bacad5848cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.864421 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e007df8-517b-41b0-969b-bacad5848cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.865457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e007df8-517b-41b0-969b-bacad5848cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.867310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e007df8-517b-41b0-969b-bacad5848cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.868200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e007df8-517b-41b0-969b-bacad5848cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.873250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e007df8-517b-41b0-969b-bacad5848cf1 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.893612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 874/1784] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:31 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:31.902060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 911/1785] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:31 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:31.904660 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e007df8-517b-41b0-969b-bacad5848cf1 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.904932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb314d-fc68-4d0f-9602-81c74a462511 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:31.922583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb314d-fc68-4d0f-9602-81c74a462511 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.929822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e007df8-517b-41b0-969b-bacad5848cf1 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:31.930346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919a8b0-d84c-4f28-9696-4f60283fdda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.932495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919a8b0-d84c-4f28-9696-4f60283fdda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.933053 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919a8b0-d84c-4f28-9696-4f60283fdda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.933466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919a8b0-d84c-4f28-9696-4f60283fdda5 admin admin] PATH_INFO: `/v3/projects/14636af2a1404870aa77f4437f36622c/users/b1908f7ee6c1463abd8cea5efdd5d817/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.941753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc58ae-7d4d-402e-ba79-70c12e03451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:31.943474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc58ae-7d4d-402e-ba79-70c12e03451e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:31.943968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc58ae-7d4d-402e-ba79-70c12e03451e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:31.944430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc58ae-7d4d-402e-ba79-70c12e03451e admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:31.945572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc58ae-7d4d-402e-ba79-70c12e03451e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.947662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc58ae-7d4d-402e-ba79-70c12e03451e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.957779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919a8b0-d84c-4f28-9696-4f60283fdda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14636af2a1404870aa77f4437f36622c, user_id=b1908f7ee6c1463abd8cea5efdd5d817, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:31.974484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919a8b0-d84c-4f28-9696-4f60283fdda5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:31.980261 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 875/1786] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:31 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:31.984923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc58ae-7d4d-402e-ba79-70c12e03451e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:32.000309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 912/1787] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:31 2021] PUT /identity/v3/projects/14636af2a1404870aa77f4437f36622c/users/b1908f7ee6c1463abd8cea5efdd5d817/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:32.012013 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95176bd-f1a7-4b60-9239-57b832c9058c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.012319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc58ae-7d4d-402e-ba79-70c12e03451e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:32.012762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95176bd-f1a7-4b60-9239-57b832c9058c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.013256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95176bd-f1a7-4b60-9239-57b832c9058c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.077951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c95176bd-f1a7-4b60-9239-57b832c9058c None None] MFA Rules not processed for user `b1908f7ee6c1463abd8cea5efdd5d817`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:32.081516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c95176bd-f1a7-4b60-9239-57b832c9058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:32.095417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db52ba-031b-4d00-8c5d-19f3f9fc72d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:32.096450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db52ba-031b-4d00-8c5d-19f3f9fc72d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.096884 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db52ba-031b-4d00-8c5d-19f3f9fc72d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.097238 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db52ba-031b-4d00-8c5d-19f3f9fc72d9 admin admin] PATH_INFO: `/v3/projects/1a28a133fd354df98c786acf26cb2b28/users/3b73b887d51f4e489621ca81f01efbd9/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.118187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db52ba-031b-4d00-8c5d-19f3f9fc72d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a28a133fd354df98c786acf26cb2b28, user_id=3b73b887d51f4e489621ca81f01efbd9, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:32.121839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db52ba-031b-4d00-8c5d-19f3f9fc72d9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:32.145026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 876/1788] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:31 2021] PUT /identity/v3/projects/1a28a133fd354df98c786acf26cb2b28/users/3b73b887d51f4e489621ca81f01efbd9/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:32.155514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c257ba-fb52-4bda-bcc3-b2e9793ef634 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.155679 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c257ba-fb52-4bda-bcc3-b2e9793ef634 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.155966 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c257ba-fb52-4bda-bcc3-b2e9793ef634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.196628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 913/1789] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:32 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:32.202465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-00c257ba-fb52-4bda-bcc3-b2e9793ef634 None None] MFA Rules not processed for user `3b73b887d51f4e489621ca81f01efbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:32.202944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95176bd-f1a7-4b60-9239-57b832c9058c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:32.204611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-00c257ba-fb52-4bda-bcc3-b2e9793ef634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:32.229302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95176bd-f1a7-4b60-9239-57b832c9058c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:32.303277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 877/1790] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:32 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:32.311596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c257ba-fb52-4bda-bcc3-b2e9793ef634 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:32.346510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e41a26-d006-44fa-b2e8-c46c6a2b2334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:32.347200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e41a26-d006-44fa-b2e8-c46c6a2b2334 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.347484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e41a26-d006-44fa-b2e8-c46c6a2b2334 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.347761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e41a26-d006-44fa-b2e8-c46c6a2b2334 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.349029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e41a26-d006-44fa-b2e8-c46c6a2b2334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:32.351124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e41a26-d006-44fa-b2e8-c46c6a2b2334 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:32.383498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 914/1791] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:32 2021] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:32.387807 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e41a26-d006-44fa-b2e8-c46c6a2b2334 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:32.423332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c257ba-fb52-4bda-bcc3-b2e9793ef634 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:32.460996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e41a26-d006-44fa-b2e8-c46c6a2b2334 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:32.468587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d869a4-16dc-4c77-97ef-6b15998290e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:32.469338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d869a4-16dc-4c77-97ef-6b15998290e6 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.469707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d869a4-16dc-4c77-97ef-6b15998290e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.470046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d869a4-16dc-4c77-97ef-6b15998290e6 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.470826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d869a4-16dc-4c77-97ef-6b15998290e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:32.473508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d869a4-16dc-4c77-97ef-6b15998290e6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:32.489327 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8a6a-0ebd-46b4-88c9-54cc3801d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:32.489972 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8a6a-0ebd-46b4-88c9-54cc3801d4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.490253 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8a6a-0ebd-46b4-88c9-54cc3801d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.490578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8a6a-0ebd-46b4-88c9-54cc3801d4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.491355 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc8a6a-0ebd-46b4-88c9-54cc3801d4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:32.493617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc8a6a-0ebd-46b4-88c9-54cc3801d4f0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:32.500780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 915/1792] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:32 2021] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:32.505389 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d869a4-16dc-4c77-97ef-6b15998290e6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:32.543358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d869a4-16dc-4c77-97ef-6b15998290e6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:32.552872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685e11-1435-4834-86f7-440d1efc5820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:32.553721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685e11-1435-4834-86f7-440d1efc5820 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.556610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685e11-1435-4834-86f7-440d1efc5820 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.557001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685e11-1435-4834-86f7-440d1efc5820 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.557936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685e11-1435-4834-86f7-440d1efc5820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:32.559738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685e11-1435-4834-86f7-440d1efc5820 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:32.563460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 878/1793] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:32 2021] POST /identity/v3/projects => generated 371 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:32.567338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8a6a-0ebd-46b4-88c9-54cc3801d4f0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:32.574414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 916/1794] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:32 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:32.575686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685e11-1435-4834-86f7-440d1efc5820 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:32.585795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685e11-1435-4834-86f7-440d1efc5820 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:32.691452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8766f44-6f84-4f36-9321-6acde26a2b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:32.693386 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8766f44-6f84-4f36-9321-6acde26a2b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.693771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8766f44-6f84-4f36-9321-6acde26a2b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.695399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8766f44-6f84-4f36-9321-6acde26a2b85 admin admin] PATH_INFO: `/v3/projects/59c3f705e3f142d5808c0521e4085c8c/users/e81ce3abe83f46a48b54a3b9f9b010bc/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.712545 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8a6a-0ebd-46b4-88c9-54cc3801d4f0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:32.714137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8766f44-6f84-4f36-9321-6acde26a2b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c3f705e3f142d5808c0521e4085c8c, user_id=e81ce3abe83f46a48b54a3b9f9b010bc, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:32.722294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8766f44-6f84-4f36-9321-6acde26a2b85 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:32.729649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ed40d-ccf0-4a2d-b8f3-130cd2a86e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:32.730384 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ed40d-ccf0-4a2d-b8f3-130cd2a86e3f admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.730705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ed40d-ccf0-4a2d-b8f3-130cd2a86e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.731032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ed40d-ccf0-4a2d-b8f3-130cd2a86e3f admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.731700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ed40d-ccf0-4a2d-b8f3-130cd2a86e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:32.744819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 917/1795] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:32 2021] PUT /identity/v3/projects/59c3f705e3f142d5808c0521e4085c8c/users/e81ce3abe83f46a48b54a3b9f9b010bc/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:32.746531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ed40d-ccf0-4a2d-b8f3-130cd2a86e3f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:32.761200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8766f44-6f84-4f36-9321-6acde26a2b85 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:32.806416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 879/1796] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:32 2021] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:32.810163 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ed40d-ccf0-4a2d-b8f3-130cd2a86e3f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:32.841296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ed40d-ccf0-4a2d-b8f3-130cd2a86e3f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:32.910840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8766f44-6f84-4f36-9321-6acde26a2b85 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:32.932972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb38a49-0240-4e5e-b0ea-bc70f99dd436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:32.935425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38a49-0240-4e5e-b0ea-bc70f99dd436 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.935787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38a49-0240-4e5e-b0ea-bc70f99dd436 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.937730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38a49-0240-4e5e-b0ea-bc70f99dd436 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.942714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb38a49-0240-4e5e-b0ea-bc70f99dd436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:32.942714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb38a49-0240-4e5e-b0ea-bc70f99dd436 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:32.966880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e1dd1-5630-433f-90af-bb46298f910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:32.967619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e1dd1-5630-433f-90af-bb46298f910a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.967904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e1dd1-5630-433f-90af-bb46298f910a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.968177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e1dd1-5630-433f-90af-bb46298f910a admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.968747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 918/1797] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:32 2021] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:32.970114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea52b0-96d1-4ae2-8344-74fde254bd18 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:32.970412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea52b0-96d1-4ae2-8344-74fde254bd18 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:32.970700 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea52b0-96d1-4ae2-8344-74fde254bd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:32.972394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e1dd1-5630-433f-90af-bb46298f910a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:32.974002 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e1dd1-5630-433f-90af-bb46298f910a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:32.999578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 880/1798] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:32 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:32.999578 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e1dd1-5630-433f-90af-bb46298f910a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:33.012816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-80ea52b0-96d1-4ae2-8344-74fde254bd18 None None] MFA Rules not processed for user `e85a2de1c4214589916a2ef12655c5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:33.013105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e1dd1-5630-433f-90af-bb46298f910a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:33.015045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-80ea52b0-96d1-4ae2-8344-74fde254bd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:33.018549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb8c1-3a88-4f0f-bb3a-77d911019b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:33.019520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb8c1-3a88-4f0f-bb3a-77d911019b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:33.019963 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb8c1-3a88-4f0f-bb3a-77d911019b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:33.020304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb8c1-3a88-4f0f-bb3a-77d911019b47 admin admin] PATH_INFO: `/v3/projects/59c3f705e3f142d5808c0521e4085c8c/users/e81ce3abe83f46a48b54a3b9f9b010bc/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:33.022917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bb8c1-3a88-4f0f-bb3a-77d911019b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c3f705e3f142d5808c0521e4085c8c, user_id=e81ce3abe83f46a48b54a3b9f9b010bc, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:33.026144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bb8c1-3a88-4f0f-bb3a-77d911019b47 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:33.042770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 881/1799] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:32 2021] PUT /identity/v3/projects/59c3f705e3f142d5808c0521e4085c8c/users/e81ce3abe83f46a48b54a3b9f9b010bc/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:33.044187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb8c1-3a88-4f0f-bb3a-77d911019b47 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:33.121848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 919/1800] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:32 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:33.126752 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5cc4b-eeb5-4c20-8f25-9818814d428a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:33.126752 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5cc4b-eeb5-4c20-8f25-9818814d428a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:33.126752 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5cc4b-eeb5-4c20-8f25-9818814d428a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:33.135289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb8c1-3a88-4f0f-bb3a-77d911019b47 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:33.140401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32e4a6-1b24-4ad6-8a4e-ad55ac69a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:33.141430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32e4a6-1b24-4ad6-8a4e-ad55ac69a7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:33.141712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32e4a6-1b24-4ad6-8a4e-ad55ac69a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:33.141985 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32e4a6-1b24-4ad6-8a4e-ad55ac69a7c3 admin admin] PATH_INFO: `/v3/projects/0ad973b12b304a09bd7d899ab0ea9397/users/c43e4f5269a34cd0bd51f49bf5aa23b9/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:33.158259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32e4a6-1b24-4ad6-8a4e-ad55ac69a7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad973b12b304a09bd7d899ab0ea9397, user_id=c43e4f5269a34cd0bd51f49bf5aa23b9, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:33.161860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32e4a6-1b24-4ad6-8a4e-ad55ac69a7c3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:33.192143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 882/1801] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:33 2021] PUT /identity/v3/projects/0ad973b12b304a09bd7d899ab0ea9397/users/c43e4f5269a34cd0bd51f49bf5aa23b9/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:33.195631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32e4a6-1b24-4ad6-8a4e-ad55ac69a7c3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:33.196039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-4cb5cc4b-eeb5-4c20-8f25-9818814d428a None None] MFA Rules not processed for user `e81ce3abe83f46a48b54a3b9f9b010bc`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:33.198111 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4cb5cc4b-eeb5-4c20-8f25-9818814d428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:33.272539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32e4a6-1b24-4ad6-8a4e-ad55ac69a7c3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:33.278807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58c6ef-65d4-4c79-9b03-c802dcd4cf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:33.279477 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c6ef-65d4-4c79-9b03-c802dcd4cf5c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:33.279882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c6ef-65d4-4c79-9b03-c802dcd4cf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:33.280211 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c6ef-65d4-4c79-9b03-c802dcd4cf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:33.280944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58c6ef-65d4-4c79-9b03-c802dcd4cf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:33.282671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58c6ef-65d4-4c79-9b03-c802dcd4cf5c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:33.294101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 883/1802] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:33 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:33.297775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58c6ef-65d4-4c79-9b03-c802dcd4cf5c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:33.303864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 920/1803] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:33 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:33.310151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58c6ef-65d4-4c79-9b03-c802dcd4cf5c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:33.314768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5cc4b-eeb5-4c20-8f25-9818814d428a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:33.315018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23b773-0f26-49e0-a972-8315dc1b7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:33.315906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23b773-0f26-49e0-a972-8315dc1b7d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:33.316194 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23b773-0f26-49e0-a972-8315dc1b7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:33.316470 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23b773-0f26-49e0-a972-8315dc1b7d01 admin admin] PATH_INFO: `/v3/projects/0ad973b12b304a09bd7d899ab0ea9397/users/c43e4f5269a34cd0bd51f49bf5aa23b9/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:33.318825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23b773-0f26-49e0-a972-8315dc1b7d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad973b12b304a09bd7d899ab0ea9397, user_id=c43e4f5269a34cd0bd51f49bf5aa23b9, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:33.321521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23b773-0f26-49e0-a972-8315dc1b7d01 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:33.327683 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4cb5cc4b-eeb5-4c20-8f25-9818814d428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:33.332860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 884/1804] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:33 2021] PUT /identity/v3/projects/0ad973b12b304a09bd7d899ab0ea9397/users/c43e4f5269a34cd0bd51f49bf5aa23b9/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:33.350630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561746c3-634f-4235-a075-289cc045e0eb None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:33.350630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561746c3-634f-4235-a075-289cc045e0eb None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:33.350630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561746c3-634f-4235-a075-289cc045e0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:33.406572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-561746c3-634f-4235-a075-289cc045e0eb None None] MFA Rules not processed for user `c43e4f5269a34cd0bd51f49bf5aa23b9`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:33.408060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-561746c3-634f-4235-a075-289cc045e0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:33.429162 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5cc4b-eeb5-4c20-8f25-9818814d428a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:33.506839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 885/1805] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:33 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:33.527709 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b680b-6745-415f-a78e-3ff9e126bf02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:33.528535 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b680b-6745-415f-a78e-3ff9e126bf02 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:33.528930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b680b-6745-415f-a78e-3ff9e126bf02 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:33.529662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b680b-6745-415f-a78e-3ff9e126bf02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:33.624729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b680b-6745-415f-a78e-3ff9e126bf02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:33.626246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b680b-6745-415f-a78e-3ff9e126bf02 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:33.653327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 921/1806] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:33 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:33.689064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561746c3-634f-4235-a075-289cc045e0eb None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:33.691209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-561746c3-634f-4235-a075-289cc045e0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:33.696692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b680b-6745-415f-a78e-3ff9e126bf02 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:33.707839 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b680b-6745-415f-a78e-3ff9e126bf02 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:33.711781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561746c3-634f-4235-a075-289cc045e0eb None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:33.713224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab5a67-28dc-4a80-a770-0b806a3db5f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:33.713981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab5a67-28dc-4a80-a770-0b806a3db5f9 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:33.714318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab5a67-28dc-4a80-a770-0b806a3db5f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:33.714660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab5a67-28dc-4a80-a770-0b806a3db5f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:33.723937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4a66f-f79c-4ffb-b9d1-394a7d1f8a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:33.724622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4a66f-f79c-4ffb-b9d1-394a7d1f8a35 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:33.724941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4a66f-f79c-4ffb-b9d1-394a7d1f8a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:33.726734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4a66f-f79c-4ffb-b9d1-394a7d1f8a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:33.741871 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4a66f-f79c-4ffb-b9d1-394a7d1f8a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:33.743644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4a66f-f79c-4ffb-b9d1-394a7d1f8a35 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:33.779587 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 886/1807] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:33 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:33.795818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab5a67-28dc-4a80-a770-0b806a3db5f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:33.799490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab5a67-28dc-4a80-a770-0b806a3db5f9 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:33.823647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 922/1808] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:33 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:34.190800 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f206f6b-3376-4234-bc7e-1eff90a9a194 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:34.192935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f206f6b-3376-4234-bc7e-1eff90a9a194 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:34.194273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f206f6b-3376-4234-bc7e-1eff90a9a194 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:34.197153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 887/1809] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 25 01:27:34 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:27:34.222190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d58b87-0d55-4bf4-81a1-c18826b8021d None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:34.222503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d58b87-0d55-4bf4-81a1-c18826b8021d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:34.223020 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d58b87-0d55-4bf4-81a1-c18826b8021d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:34.265490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-45d58b87-0d55-4bf4-81a1-c18826b8021d None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:34.271010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-45d58b87-0d55-4bf4-81a1-c18826b8021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:34.461850 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 923/1810] 10.222.0.23 () {58 vars in 1019 bytes} [Wed Aug 25 01:27:34 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:34.658814 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f206f6b-3376-4234-bc7e-1eff90a9a194 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:34.662103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8f206f6b-3376-4234-bc7e-1eff90a9a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:34.688718 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f206f6b-3376-4234-bc7e-1eff90a9a194 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:34.704887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f34ec-415f-4988-a564-21c6c63a636f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:34.705804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f34ec-415f-4988-a564-21c6c63a636f service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:34.706362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f34ec-415f-4988-a564-21c6c63a636f service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:34.706877 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f34ec-415f-4988-a564-21c6c63a636f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:34.718049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f34ec-415f-4988-a564-21c6c63a636f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:34.722362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f34ec-415f-4988-a564-21c6c63a636f service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:34.747421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d58b87-0d55-4bf4-81a1-c18826b8021d None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:34.767915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 888/1811] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:34.877407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d58b87-0d55-4bf4-81a1-c18826b8021d None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:34.888155 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:34.890821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:34.891170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:34.891593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] PATH_INFO: `/v3/users/3b73b887d51f4e489621ca81f01efbd9` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:34.893906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b73b887d51f4e489621ca81f01efbd9)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:34.897306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:35.049434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b73b887d51f4e489621ca81f01efbd9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:35.077195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b73b887d51f4e489621ca81f01efbd9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:35.078593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b73b887d51f4e489621ca81f01efbd9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:35.099697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b73b887d51f4e489621ca81f01efbd9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:35.105452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b73b887d51f4e489621ca81f01efbd9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:35.136216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039bee3-32ce-4fac-b9bf-5b52e987d858 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:35.136512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039bee3-32ce-4fac-b9bf-5b52e987d858 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:35.136799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039bee3-32ce-4fac-b9bf-5b52e987d858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:35.138122 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 924/1812] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:34 2021] DELETE /identity/v3/users/3b73b887d51f4e489621ca81f01efbd9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:35.164377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-4039bee3-32ce-4fac-b9bf-5b52e987d858 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:35.167758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-4039bee3-32ce-4fac-b9bf-5b52e987d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:35.269285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 889/1813] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:35.278626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:35.281034 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:35.368433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28c524-518f-405a-bbc8-74e1badec64a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:35.373318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0cb83-32b0-41f2-ac57-b853217eabdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:35.374371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0cb83-32b0-41f2-ac57-b853217eabdf service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:35.374907 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0cb83-32b0-41f2-ac57-b853217eabdf service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:35.375274 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0cb83-32b0-41f2-ac57-b853217eabdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:35.387620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0cb83-32b0-41f2-ac57-b853217eabdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:35.389602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0cb83-32b0-41f2-ac57-b853217eabdf service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:35.405080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 925/1814] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:35.698002 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039bee3-32ce-4fac-b9bf-5b52e987d858 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:35.699771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-4039bee3-32ce-4fac-b9bf-5b52e987d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:35.720497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039bee3-32ce-4fac-b9bf-5b52e987d858 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:35.728107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:35.729435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:35.729911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:35.730371 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] PATH_INFO: `/v3/users/aedef19e6dbc497497b33afbbbe0e200` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:35.731871 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aedef19e6dbc497497b33afbbbe0e200)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:35.733983 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:35.803751 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aedef19e6dbc497497b33afbbbe0e200'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:35.811066 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aedef19e6dbc497497b33afbbbe0e200'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:35.817389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aedef19e6dbc497497b33afbbbe0e200'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:35.817389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aedef19e6dbc497497b33afbbbe0e200'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:35.840819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aedef19e6dbc497497b33afbbbe0e200'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:35.878293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 890/1815] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:35 2021] DELETE /identity/v3/users/aedef19e6dbc497497b33afbbbe0e200 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:35.887419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974981cd-06cf-4093-8f7e-bf0bcdf62aa3 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:35.889637 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974981cd-06cf-4093-8f7e-bf0bcdf62aa3 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:35.891013 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974981cd-06cf-4093-8f7e-bf0bcdf62aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:35.930404 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-974981cd-06cf-4093-8f7e-bf0bcdf62aa3 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:35.932609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-974981cd-06cf-4093-8f7e-bf0bcdf62aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:36.047016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 926/1816] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:36.097329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:36.099874 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:36.225446 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eed2d-4fd8-4fb0-831d-43c5444836cc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:36.241683 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd33ca-590f-4a72-bc53-6462f3a321ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:36.242367 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd33ca-590f-4a72-bc53-6462f3a321ed service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:36.242658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd33ca-590f-4a72-bc53-6462f3a321ed service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:36.242959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd33ca-590f-4a72-bc53-6462f3a321ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:36.263553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd33ca-590f-4a72-bc53-6462f3a321ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:36.265252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd33ca-590f-4a72-bc53-6462f3a321ed service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:36.285932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 891/1817] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:36.969586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974981cd-06cf-4093-8f7e-bf0bcdf62aa3 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:36.971235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-974981cd-06cf-4093-8f7e-bf0bcdf62aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:36.985574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974981cd-06cf-4093-8f7e-bf0bcdf62aa3 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:36.993210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:36.994319 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:36.994597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:36.995058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] PATH_INFO: `/v3/projects/1a28a133fd354df98c786acf26cb2b28` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:36.996439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a28a133fd354df98c786acf26cb2b28)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:36.999343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:37.061200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a28a133fd354df98c786acf26cb2b28', 'request_id': 'req-44b65618-c54f-4db9-b17c-b3a3f60bd01e'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.068560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a28a133fd354df98c786acf26cb2b28', 'request_id': 'req-44b65618-c54f-4db9-b17c-b3a3f60bd01e'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.079344 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a28a133fd354df98c786acf26cb2b28', 'request_id': 'req-44b65618-c54f-4db9-b17c-b3a3f60bd01e'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.103314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] The token cache is being invalidate because project 1a28a133fd354df98c786acf26cb2b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:37.104435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.107231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.111562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 927/1818] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:36 2021] DELETE /identity/v3/projects/1a28a133fd354df98c786acf26cb2b28 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:37.112925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd33ca-590f-4a72-bc53-6462f3a321ed service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:37.125204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd33ca-590f-4a72-bc53-6462f3a321ed service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:37.190041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:37.190924 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:37.191408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:37.191915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] PATH_INFO: `/v3/users/c43e4f5269a34cd0bd51f49bf5aa23b9` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:37.193410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43e4f5269a34cd0bd51f49bf5aa23b9)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:37.195789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:37.252543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43e4f5269a34cd0bd51f49bf5aa23b9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.255208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:37.256705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:37.271680 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b65618-c54f-4db9-b17c-b3a3f60bd01e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:37.272657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43e4f5269a34cd0bd51f49bf5aa23b9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.273552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43e4f5269a34cd0bd51f49bf5aa23b9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.274227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43e4f5269a34cd0bd51f49bf5aa23b9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.279124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:37.280285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:37.280751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:37.280868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] PATH_INFO: `/v3/projects/7402c0c6a4b747aeb4ecd71854b2c7e8` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:37.282161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7402c0c6a4b747aeb4ecd71854b2c7e8)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:37.284463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:37.289957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43e4f5269a34cd0bd51f49bf5aa23b9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.315607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 892/1819] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:37 2021] DELETE /identity/v3/users/c43e4f5269a34cd0bd51f49bf5aa23b9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:37.344444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7402c0c6a4b747aeb4ecd71854b2c7e8', 'request_id': 'req-e02490b6-a2f7-4a75-aab2-4195cdf1814b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.351659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7402c0c6a4b747aeb4ecd71854b2c7e8', 'request_id': 'req-e02490b6-a2f7-4a75-aab2-4195cdf1814b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.357273 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7402c0c6a4b747aeb4ecd71854b2c7e8', 'request_id': 'req-e02490b6-a2f7-4a75-aab2-4195cdf1814b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.376412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] The token cache is being invalidate because project 7402c0c6a4b747aeb4ecd71854b2c7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:37.376992 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.378294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.384881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 928/1820] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:37 2021] DELETE /identity/v3/projects/7402c0c6a4b747aeb4ecd71854b2c7e8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:37.386955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:37.388556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:37.467464 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:37.468950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:37.489856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28138dcf-04b5-490f-8312-226392e3717d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:37.565320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:37.566245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:37.566485 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:37.567465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] PATH_INFO: `/v3/users/13b62e498af94276abaa4e9c9a301d26` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:37.568867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02490b6-a2f7-4a75-aab2-4195cdf1814b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:37.569151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b62e498af94276abaa4e9c9a301d26)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:37.571134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:37.574662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:37.575703 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:37.576088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:37.576466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] PATH_INFO: `/v3/users/b44dcf0b336b472bac8beb366029a348` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:37.577960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44dcf0b336b472bac8beb366029a348)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:37.581062 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:37.634432 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b62e498af94276abaa4e9c9a301d26'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.645514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b62e498af94276abaa4e9c9a301d26'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.647236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b62e498af94276abaa4e9c9a301d26'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.648116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b62e498af94276abaa4e9c9a301d26'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.662554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b62e498af94276abaa4e9c9a301d26'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.665478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44dcf0b336b472bac8beb366029a348'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.691306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 893/1821] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:37 2021] DELETE /identity/v3/users/13b62e498af94276abaa4e9c9a301d26 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:37.692986 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:37.709235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:37.722302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44dcf0b336b472bac8beb366029a348'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.723295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44dcf0b336b472bac8beb366029a348'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.741074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44dcf0b336b472bac8beb366029a348'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.741886 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0d410d45-43df-4b8a-aba6-979b2e433d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44dcf0b336b472bac8beb366029a348'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:37.766853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 929/1822] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:37 2021] DELETE /identity/v3/users/b44dcf0b336b472bac8beb366029a348 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:37.768836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced73b4-5f09-44b9-969a-e369a23cde76 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:37.769135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced73b4-5f09-44b9-969a-e369a23cde76 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:37.769413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced73b4-5f09-44b9-969a-e369a23cde76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:37.810075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-bced73b4-5f09-44b9-969a-e369a23cde76 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:37.814022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-bced73b4-5f09-44b9-969a-e369a23cde76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:37.878986 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fbf65-42f0-4700-b392-c161c64a986c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:37.986325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 930/1823] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:38.009820 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced73b4-5f09-44b9-969a-e369a23cde76 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:38.011412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-bced73b4-5f09-44b9-969a-e369a23cde76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:38.014271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:38.015779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.016126 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.016414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] PATH_INFO: `/v3/projects/0ad973b12b304a09bd7d899ab0ea9397` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.017707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad973b12b304a09bd7d899ab0ea9397)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:38.022434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:38.170186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad973b12b304a09bd7d899ab0ea9397', 'request_id': 'req-c53b48cd-ce8d-48b1-8710-c70263ea8372'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:38.189689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad973b12b304a09bd7d899ab0ea9397', 'request_id': 'req-c53b48cd-ce8d-48b1-8710-c70263ea8372'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:38.207995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad973b12b304a09bd7d899ab0ea9397', 'request_id': 'req-c53b48cd-ce8d-48b1-8710-c70263ea8372'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:38.247476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] The token cache is being invalidate because project 0ad973b12b304a09bd7d899ab0ea9397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:38.248062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:38.248959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c53b48cd-ce8d-48b1-8710-c70263ea8372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:38.252827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 894/1824] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:37 2021] DELETE /identity/v3/projects/0ad973b12b304a09bd7d899ab0ea9397 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:38.258840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fcedc-fd93-4f8c-95c5-e43c3914f702 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.259371 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fcedc-fd93-4f8c-95c5-e43c3914f702 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.259854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fcedc-fd93-4f8c-95c5-e43c3914f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.282331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-e47fcedc-fd93-4f8c-95c5-e43c3914f702 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:38.283786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e47fcedc-fd93-4f8c-95c5-e43c3914f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:38.293772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced73b4-5f09-44b9-969a-e369a23cde76 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:38.433290 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 895/1825] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:38.435225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01541ae3-da3d-4415-b3a3-9f4c00d63b4e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.435225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01541ae3-da3d-4415-b3a3-9f4c00d63b4e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.436971 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01541ae3-da3d-4415-b3a3-9f4c00d63b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.474210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba585641-3032-4721-a638-3df2712cfe76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:38.479902 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba585641-3032-4721-a638-3df2712cfe76 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.481169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba585641-3032-4721-a638-3df2712cfe76 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.493363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba585641-3032-4721-a638-3df2712cfe76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.501169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-01541ae3-da3d-4415-b3a3-9f4c00d63b4e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:38.506742 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-01541ae3-da3d-4415-b3a3-9f4c00d63b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:38.512300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ba585641-3032-4721-a638-3df2712cfe76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:38.530601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba585641-3032-4721-a638-3df2712cfe76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:38.533734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba585641-3032-4721-a638-3df2712cfe76 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:38.544046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 896/1826] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:38.547160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 931/1827] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:38.553591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01541ae3-da3d-4415-b3a3-9f4c00d63b4e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:38.566319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01541ae3-da3d-4415-b3a3-9f4c00d63b4e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:38.572723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d340ac-6511-41ad-ade7-7a326bbf2b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:38.573568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d340ac-6511-41ad-ade7-7a326bbf2b8d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.574171 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d340ac-6511-41ad-ade7-7a326bbf2b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.574520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d340ac-6511-41ad-ade7-7a326bbf2b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.575374 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d340ac-6511-41ad-ade7-7a326bbf2b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:38.576016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d340ac-6511-41ad-ade7-7a326bbf2b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:38.577471 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d340ac-6511-41ad-ade7-7a326bbf2b8d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:38.591701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 897/1828] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:38.596373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba585641-3032-4721-a638-3df2712cfe76 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:38.615843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba585641-3032-4721-a638-3df2712cfe76 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:38.621013 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740530d-0697-41fa-8555-da2a06a5dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:38.621690 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740530d-0697-41fa-8555-da2a06a5dd00 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.621991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740530d-0697-41fa-8555-da2a06a5dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.622243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740530d-0697-41fa-8555-da2a06a5dd00 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.623341 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740530d-0697-41fa-8555-da2a06a5dd00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:38.625570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740530d-0697-41fa-8555-da2a06a5dd00 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:38.665240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 932/1829] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:38 2021] POST /identity/v3/projects => generated 393 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:38.669669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d340ac-6511-41ad-ade7-7a326bbf2b8d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:38.687721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d340ac-6511-41ad-ade7-7a326bbf2b8d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:38.755422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740530d-0697-41fa-8555-da2a06a5dd00 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:38.758308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e740530d-0697-41fa-8555-da2a06a5dd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:38.796374 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25449aae-47a4-4952-9f75-c3ee1d8add9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:38.797101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25449aae-47a4-4952-9f75-c3ee1d8add9d admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.797419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25449aae-47a4-4952-9f75-c3ee1d8add9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.797821 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25449aae-47a4-4952-9f75-c3ee1d8add9d admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.798532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25449aae-47a4-4952-9f75-c3ee1d8add9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:38.801358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25449aae-47a4-4952-9f75-c3ee1d8add9d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:38.827906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 898/1830] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:38 2021] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:38.829592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25449aae-47a4-4952-9f75-c3ee1d8add9d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:38.840900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25449aae-47a4-4952-9f75-c3ee1d8add9d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:38.846541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da40db-99af-4730-9cce-7d2d3b68af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:38.846802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740530d-0697-41fa-8555-da2a06a5dd00 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:38.847399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da40db-99af-4730-9cce-7d2d3b68af2d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.847780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da40db-99af-4730-9cce-7d2d3b68af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.848812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da40db-99af-4730-9cce-7d2d3b68af2d admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.849612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da40db-99af-4730-9cce-7d2d3b68af2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:38.851320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da40db-99af-4730-9cce-7d2d3b68af2d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:38.852497 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:38.853871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.854177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.854843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] PATH_INFO: `/v3/projects/5d157ea172484660ad2c4c6e9421106f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.855736 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d157ea172484660ad2c4c6e9421106f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:38.858136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:38.865406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 899/1831] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:38.866594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da40db-99af-4730-9cce-7d2d3b68af2d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:38.878280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da40db-99af-4730-9cce-7d2d3b68af2d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:38.883618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2bd36-d836-474d-bd9c-d996f238df92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:38.884386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2bd36-d836-474d-bd9c-d996f238df92 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.884739 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2bd36-d836-474d-bd9c-d996f238df92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.885087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2bd36-d836-474d-bd9c-d996f238df92 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.885885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2bd36-d836-474d-bd9c-d996f238df92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:38.887604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2bd36-d836-474d-bd9c-d996f238df92 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:38.902914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 900/1832] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:38.907648 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2bd36-d836-474d-bd9c-d996f238df92 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:38.914939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d157ea172484660ad2c4c6e9421106f', 'request_id': 'req-5bf7587d-4918-4ab4-a483-af765bbdf610'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:38.923298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2bd36-d836-474d-bd9c-d996f238df92 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:38.925619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d157ea172484660ad2c4c6e9421106f', 'request_id': 'req-5bf7587d-4918-4ab4-a483-af765bbdf610'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:38.938491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d157ea172484660ad2c4c6e9421106f', 'request_id': 'req-5bf7587d-4918-4ab4-a483-af765bbdf610'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:38.964250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] The token cache is being invalidate because project 5d157ea172484660ad2c4c6e9421106f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:38.966097 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:38.967760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5bf7587d-4918-4ab4-a483-af765bbdf610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:38.976462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 933/1833] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:38 2021] DELETE /identity/v3/projects/5d157ea172484660ad2c4c6e9421106f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:38.978354 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782a0c3-ba79-49b9-b20d-8d5a2decfa22 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:38.978645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782a0c3-ba79-49b9-b20d-8d5a2decfa22 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:38.978949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782a0c3-ba79-49b9-b20d-8d5a2decfa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:38.999875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965abb54-fb97-4fb3-abac-f74375947ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:39.000778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965abb54-fb97-4fb3-abac-f74375947ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:39.001061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965abb54-fb97-4fb3-abac-f74375947ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:39.001333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965abb54-fb97-4fb3-abac-f74375947ae8 admin admin] PATH_INFO: `/v3/projects/3a6badbb993c460185d1938f89e63a5c/users/c497d997d1964bdc9e48dbd08a5a8440/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:39.030705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7782a0c3-ba79-49b9-b20d-8d5a2decfa22 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:39.032559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7782a0c3-ba79-49b9-b20d-8d5a2decfa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:39.043619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 934/1834] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:39.052327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7363058-aa22-4db4-9ece-881895225452 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:39.052550 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7363058-aa22-4db4-9ece-881895225452 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:39.052980 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7363058-aa22-4db4-9ece-881895225452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:39.053470 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965abb54-fb97-4fb3-abac-f74375947ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6badbb993c460185d1938f89e63a5c, user_id=c497d997d1964bdc9e48dbd08a5a8440, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:39.056301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965abb54-fb97-4fb3-abac-f74375947ae8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:39.076362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 901/1835] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:38 2021] PUT /identity/v3/projects/3a6badbb993c460185d1938f89e63a5c/users/c497d997d1964bdc9e48dbd08a5a8440/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:39.085763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b7363058-aa22-4db4-9ece-881895225452 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:39.087268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b7363058-aa22-4db4-9ece-881895225452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:39.087390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b97245-e040-4c2d-a735-2ac8583e3e55 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:39.087731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b97245-e040-4c2d-a735-2ac8583e3e55 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:39.088126 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b97245-e040-4c2d-a735-2ac8583e3e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:39.149034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b0b97245-e040-4c2d-a735-2ac8583e3e55 None None] MFA Rules not processed for user `c497d997d1964bdc9e48dbd08a5a8440`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:39.150402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b0b97245-e040-4c2d-a735-2ac8583e3e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:39.176824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 935/1836] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:39.177781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7363058-aa22-4db4-9ece-881895225452 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:39.179149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b7363058-aa22-4db4-9ece-881895225452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:39.197747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7363058-aa22-4db4-9ece-881895225452 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:39.213430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:39.214468 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:39.214938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:39.215215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] PATH_INFO: `/v3/projects/807383147ea94d66a37d2df4dba0ae01` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:39.216403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=807383147ea94d66a37d2df4dba0ae01)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:39.218451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:39.268806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 902/1837] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:39 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:39.270960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b97245-e040-4c2d-a735-2ac8583e3e55 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:39.285197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b97245-e040-4c2d-a735-2ac8583e3e55 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:39.294501 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48828da3-7185-45f9-a4f3-b1b17b848a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:39.295657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48828da3-7185-45f9-a4f3-b1b17b848a35 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:39.296548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48828da3-7185-45f9-a4f3-b1b17b848a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:39.297035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48828da3-7185-45f9-a4f3-b1b17b848a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:39.299201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48828da3-7185-45f9-a4f3-b1b17b848a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:39.299873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48828da3-7185-45f9-a4f3-b1b17b848a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:39.302581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48828da3-7185-45f9-a4f3-b1b17b848a35 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:39.325801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 903/1838] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:39.327210 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48828da3-7185-45f9-a4f3-b1b17b848a35 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:39.332961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807383147ea94d66a37d2df4dba0ae01', 'request_id': 'req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:39.337149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-48828da3-7185-45f9-a4f3-b1b17b848a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:39.339836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807383147ea94d66a37d2df4dba0ae01', 'request_id': 'req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:39.358701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807383147ea94d66a37d2df4dba0ae01', 'request_id': 'req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:39.360662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48828da3-7185-45f9-a4f3-b1b17b848a35 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:39.375511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] The token cache is being invalidate because project 807383147ea94d66a37d2df4dba0ae01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:39.376041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:39.376852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:39.378655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 936/1839] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:39 2021] DELETE /identity/v3/projects/807383147ea94d66a37d2df4dba0ae01 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:39.380138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:39.386970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:39.451378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c6cb0-dbe6-442d-913c-9c10134845e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:39.452637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c6cb0-dbe6-442d-913c-9c10134845e5 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:39.453122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c6cb0-dbe6-442d-913c-9c10134845e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:39.453605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c6cb0-dbe6-442d-913c-9c10134845e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:39.454529 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c6cb0-dbe6-442d-913c-9c10134845e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:39.457864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c6cb0-dbe6-442d-913c-9c10134845e5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:39.523318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 904/1840] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:39 2021] POST /identity/v3/projects => generated 391 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:39.528561 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c6cb0-dbe6-442d-913c-9c10134845e5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:39.533175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b49ea-fb5a-4bdc-b81a-46a031703f7d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:39.537362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-be6c6cb0-dbe6-442d-913c-9c10134845e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:39.663703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c6cb0-dbe6-442d-913c-9c10134845e5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:39.674338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:39.675264 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:39.675547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:39.675825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] PATH_INFO: `/v3/users/b1908f7ee6c1463abd8cea5efdd5d817` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:39.678304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1908f7ee6c1463abd8cea5efdd5d817)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:39.684030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:39.694449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57bedb-3f9f-4fce-bd0d-0b2aa93a2d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:39.695160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57bedb-3f9f-4fce-bd0d-0b2aa93a2d26 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:39.695447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57bedb-3f9f-4fce-bd0d-0b2aa93a2d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:39.695728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57bedb-3f9f-4fce-bd0d-0b2aa93a2d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:39.696426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57bedb-3f9f-4fce-bd0d-0b2aa93a2d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:39.698352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57bedb-3f9f-4fce-bd0d-0b2aa93a2d26 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:39.778752 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 937/1841] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:39 2021] POST /identity/v3/projects => generated 373 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:39.780838 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57bedb-3f9f-4fce-bd0d-0b2aa93a2d26 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:39.784315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1908f7ee6c1463abd8cea5efdd5d817'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:39.786782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ee57bedb-3f9f-4fce-bd0d-0b2aa93a2d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:39.804194 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1908f7ee6c1463abd8cea5efdd5d817'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:39.807226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1908f7ee6c1463abd8cea5efdd5d817'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:39.809441 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1908f7ee6c1463abd8cea5efdd5d817'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:39.826711 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1908f7ee6c1463abd8cea5efdd5d817'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:39.865999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 905/1842] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:39 2021] DELETE /identity/v3/users/b1908f7ee6c1463abd8cea5efdd5d817 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:39.869412 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:39.871872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:39.956684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57bedb-3f9f-4fce-bd0d-0b2aa93a2d26 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:40.034379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81222222-3a50-4a4a-aac3-0391472b25af admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:40.049923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1dfe7-ea9a-4ab0-a02e-356b4e0b4c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:40.052050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1dfe7-ea9a-4ab0-a02e-356b4e0b4c39 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.052404 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1dfe7-ea9a-4ab0-a02e-356b4e0b4c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.052754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1dfe7-ea9a-4ab0-a02e-356b4e0b4c39 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.054928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1dfe7-ea9a-4ab0-a02e-356b4e0b4c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:40.057001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1dfe7-ea9a-4ab0-a02e-356b4e0b4c39 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:40.119175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 906/1843] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:39 2021] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:40.121716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1dfe7-ea9a-4ab0-a02e-356b4e0b4c39 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:40.153189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1dfe7-ea9a-4ab0-a02e-356b4e0b4c39 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:40.164580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd10080-95fe-4a68-b284-d96f7d7dbd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:40.165278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd10080-95fe-4a68-b284-d96f7d7dbd9b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.165564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd10080-95fe-4a68-b284-d96f7d7dbd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.168158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd10080-95fe-4a68-b284-d96f7d7dbd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.170329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd10080-95fe-4a68-b284-d96f7d7dbd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:40.182796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd10080-95fe-4a68-b284-d96f7d7dbd9b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:40.189791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17956d39-b630-47d6-9c30-886dda0eaf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:40.190492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956d39-b630-47d6-9c30-886dda0eaf4e admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.190801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956d39-b630-47d6-9c30-886dda0eaf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.191081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956d39-b630-47d6-9c30-886dda0eaf4e admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.191826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17956d39-b630-47d6-9c30-886dda0eaf4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:40.194238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17956d39-b630-47d6-9c30-886dda0eaf4e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:40.218502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 907/1844] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:40 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:40.223919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd10080-95fe-4a68-b284-d96f7d7dbd9b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:40.254295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 938/1845] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:39 2021] POST /identity/v3/users => generated 302 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:40.255694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17956d39-b630-47d6-9c30-886dda0eaf4e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:40.257784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-17956d39-b630-47d6-9c30-886dda0eaf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:40.262669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd10080-95fe-4a68-b284-d96f7d7dbd9b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:40.281175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9412-612c-4c62-893f-b671b52d2ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:40.283720 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9412-612c-4c62-893f-b671b52d2ead admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.284196 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9412-612c-4c62-893f-b671b52d2ead admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.286522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9412-612c-4c62-893f-b671b52d2ead admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.287310 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf9412-612c-4c62-893f-b671b52d2ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:40.290148 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17956d39-b630-47d6-9c30-886dda0eaf4e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:40.293499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf9412-612c-4c62-893f-b671b52d2ead admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:40.308746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c3731-4fe7-443c-b41f-c691f5a960a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:40.309454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c3731-4fe7-443c-b41f-c691f5a960a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.310900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c3731-4fe7-443c-b41f-c691f5a960a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.311191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c3731-4fe7-443c-b41f-c691f5a960a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.311940 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c3731-4fe7-443c-b41f-c691f5a960a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:40.318261 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c3731-4fe7-443c-b41f-c691f5a960a5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:40.329418 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 908/1846] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:40 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:40.335750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9412-612c-4c62-893f-b671b52d2ead admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:40.356537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 939/1847] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:40 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:40.362725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9412-612c-4c62-893f-b671b52d2ead admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:40.363103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c3731-4fe7-443c-b41f-c691f5a960a5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:40.372187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a47eda-dcc2-46ee-bef7-a611d21ae65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:40.373626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a47eda-dcc2-46ee-bef7-a611d21ae65b admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.374032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a47eda-dcc2-46ee-bef7-a611d21ae65b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.374446 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a47eda-dcc2-46ee-bef7-a611d21ae65b admin admin] PATH_INFO: `/v3/projects/bfe325632533412f8b9fc296d4d69812/users/b6a7a36dc2bf4e068317f602ff19c115/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.388119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c3731-4fe7-443c-b41f-c691f5a960a5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:40.403334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1ba7f-1920-4e7c-8bfd-e1001a00e9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:40.404593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1ba7f-1920-4e7c-8bfd-e1001a00e9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.405088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1ba7f-1920-4e7c-8bfd-e1001a00e9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.406430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1ba7f-1920-4e7c-8bfd-e1001a00e9ec admin admin] PATH_INFO: `/v3/projects/99b3095aac8c4effb28ec7a5a10c6fa1/users/0ea52fb00fd24f38bb5a4142cb76c641/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.411736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a47eda-dcc2-46ee-bef7-a611d21ae65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe325632533412f8b9fc296d4d69812, user_id=b6a7a36dc2bf4e068317f602ff19c115, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:40.419666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a47eda-dcc2-46ee-bef7-a611d21ae65b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:40.429596 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1ba7f-1920-4e7c-8bfd-e1001a00e9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b3095aac8c4effb28ec7a5a10c6fa1, user_id=0ea52fb00fd24f38bb5a4142cb76c641, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:40.433755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1ba7f-1920-4e7c-8bfd-e1001a00e9ec admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:40.450630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 909/1848] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:40 2021] PUT /identity/v3/projects/bfe325632533412f8b9fc296d4d69812/users/b6a7a36dc2bf4e068317f602ff19c115/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:40.455315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9f46-2ed0-48dd-b280-4bb07c21abb2 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.455604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9f46-2ed0-48dd-b280-4bb07c21abb2 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.455880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9f46-2ed0-48dd-b280-4bb07c21abb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.469447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 940/1849] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:40 2021] PUT /identity/v3/projects/99b3095aac8c4effb28ec7a5a10c6fa1/users/0ea52fb00fd24f38bb5a4142cb76c641/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:40.470357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1ba7f-1920-4e7c-8bfd-e1001a00e9ec admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:40.484220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-87ce9f46-2ed0-48dd-b280-4bb07c21abb2 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:40.485462 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-87ce9f46-2ed0-48dd-b280-4bb07c21abb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:40.576525 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 910/1850] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:40.586465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce9f46-2ed0-48dd-b280-4bb07c21abb2 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:40.598454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1ba7f-1920-4e7c-8bfd-e1001a00e9ec admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:40.600119 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-87ce9f46-2ed0-48dd-b280-4bb07c21abb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:40.605041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff14bb-9fae-41cc-8541-5c20f9da17ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:40.605951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff14bb-9fae-41cc-8541-5c20f9da17ad admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.606294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff14bb-9fae-41cc-8541-5c20f9da17ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.606668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff14bb-9fae-41cc-8541-5c20f9da17ad admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.607528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff14bb-9fae-41cc-8541-5c20f9da17ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:40.609595 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff14bb-9fae-41cc-8541-5c20f9da17ad admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:40.652169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 941/1851] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:40 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:40.653278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff14bb-9fae-41cc-8541-5c20f9da17ad admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:40.676848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff14bb-9fae-41cc-8541-5c20f9da17ad admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:40.703951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd334655-07c1-49a3-9bf7-2d38319d11f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:40.704883 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd334655-07c1-49a3-9bf7-2d38319d11f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.706611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd334655-07c1-49a3-9bf7-2d38319d11f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.706955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd334655-07c1-49a3-9bf7-2d38319d11f3 admin admin] PATH_INFO: `/v3/projects/99b3095aac8c4effb28ec7a5a10c6fa1/users/0ea52fb00fd24f38bb5a4142cb76c641/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.712072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd334655-07c1-49a3-9bf7-2d38319d11f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b3095aac8c4effb28ec7a5a10c6fa1, user_id=0ea52fb00fd24f38bb5a4142cb76c641, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:40.720003 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd334655-07c1-49a3-9bf7-2d38319d11f3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:40.736013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce9f46-2ed0-48dd-b280-4bb07c21abb2 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:40.761700 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 942/1852] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:40 2021] PUT /identity/v3/projects/99b3095aac8c4effb28ec7a5a10c6fa1/users/0ea52fb00fd24f38bb5a4142cb76c641/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:40.764817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc911c-8dda-4dcc-8ff8-4c844409de3b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.766961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc911c-8dda-4dcc-8ff8-4c844409de3b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.767699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc911c-8dda-4dcc-8ff8-4c844409de3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.836583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-68bc911c-8dda-4dcc-8ff8-4c844409de3b None None] MFA Rules not processed for user `0ea52fb00fd24f38bb5a4142cb76c641`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:40.838759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-68bc911c-8dda-4dcc-8ff8-4c844409de3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:40.867127 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b2b39-a7ac-4c89-a838-3cec9d8f12aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:40.868348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b2b39-a7ac-4c89-a838-3cec9d8f12aa service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:40.868636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b2b39-a7ac-4c89-a838-3cec9d8f12aa service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:40.868920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b2b39-a7ac-4c89-a838-3cec9d8f12aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:40.968197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 943/1853] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:40 2021] POST /identity/v3/auth/tokens => generated 3478 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:40.969157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc911c-8dda-4dcc-8ff8-4c844409de3b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:40.972125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-68bc911c-8dda-4dcc-8ff8-4c844409de3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:41.007309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b2b39-a7ac-4c89-a838-3cec9d8f12aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:41.008647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b2b39-a7ac-4c89-a838-3cec9d8f12aa service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:41.036921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 911/1854] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:41.037885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b2b39-a7ac-4c89-a838-3cec9d8f12aa service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:41.039246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-fa6b2b39-a7ac-4c89-a838-3cec9d8f12aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:41.100975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc911c-8dda-4dcc-8ff8-4c844409de3b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:41.110506 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:41.111499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:41.111949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:41.112585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] PATH_INFO: `/v3/projects/14636af2a1404870aa77f4437f36622c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:41.115268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14636af2a1404870aa77f4437f36622c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:41.117555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:41.123671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b2b39-a7ac-4c89-a838-3cec9d8f12aa service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:41.127641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5eb46-d30c-44b6-8bec-e23ec6ff29c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:41.128296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5eb46-d30c-44b6-8bec-e23ec6ff29c2 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:41.128722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5eb46-d30c-44b6-8bec-e23ec6ff29c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:41.129584 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5eb46-d30c-44b6-8bec-e23ec6ff29c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:41.141155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5eb46-d30c-44b6-8bec-e23ec6ff29c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:41.142628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5eb46-d30c-44b6-8bec-e23ec6ff29c2 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:41.154226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 912/1855] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:41 2021] GET /identity/v3/auth/tokens => generated 3478 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:41.185579 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14636af2a1404870aa77f4437f36622c', 'request_id': 'req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:41.195303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14636af2a1404870aa77f4437f36622c', 'request_id': 'req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:41.206637 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14636af2a1404870aa77f4437f36622c', 'request_id': 'req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:41.209055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5eb46-d30c-44b6-8bec-e23ec6ff29c2 service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:41.218503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5eb46-d30c-44b6-8bec-e23ec6ff29c2 service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:41.224502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] The token cache is being invalidate because project 14636af2a1404870aa77f4437f36622c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:41.224796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:41.225706 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:41.227477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 944/1856] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:40 2021] DELETE /identity/v3/projects/14636af2a1404870aa77f4437f36622c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:41.232288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:41.233896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:41.300292 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c411ac5-3a29-4908-ade7-fdf37966b514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:41.301581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c411ac5-3a29-4908-ade7-fdf37966b514 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:41.302008 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c411ac5-3a29-4908-ade7-fdf37966b514 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:41.302455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c411ac5-3a29-4908-ade7-fdf37966b514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:41.304608 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-4c411ac5-3a29-4908-ade7-fdf37966b514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:41.329564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d09f6-a78d-4abf-bb07-8da9e98e3ec7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:41.335173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:41.336159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:41.336452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:41.336736 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] PATH_INFO: `/v3/users/e81ce3abe83f46a48b54a3b9f9b010bc` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:41.338067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81ce3abe83f46a48b54a3b9f9b010bc)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:41.340212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:41.383699 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c411ac5-3a29-4908-ade7-fdf37966b514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:41.385556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c411ac5-3a29-4908-ade7-fdf37966b514 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:41.403475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 913/1857] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:41 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:41.420063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81ce3abe83f46a48b54a3b9f9b010bc'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:41.434338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81ce3abe83f46a48b54a3b9f9b010bc'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:41.435225 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81ce3abe83f46a48b54a3b9f9b010bc'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:41.444979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81ce3abe83f46a48b54a3b9f9b010bc'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:41.445787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-76d0b026-c72f-4c3f-bb71-b4ecb75ef2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81ce3abe83f46a48b54a3b9f9b010bc'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:41.469956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 945/1858] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:41 2021] DELETE /identity/v3/users/e81ce3abe83f46a48b54a3b9f9b010bc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:42.023763 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c411ac5-3a29-4908-ade7-fdf37966b514 service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.055315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c411ac5-3a29-4908-ade7-fdf37966b514 service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.068272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157662d-526a-41b9-a971-82018ea2f3a0 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.068593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157662d-526a-41b9-a971-82018ea2f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.068880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157662d-526a-41b9-a971-82018ea2f3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.110819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-0157662d-526a-41b9-a971-82018ea2f3a0 None None] MFA Rules not processed for user `b6a7a36dc2bf4e068317f602ff19c115`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:42.112611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0157662d-526a-41b9-a971-82018ea2f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:42.177488 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.178709 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.179158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.179438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] PATH_INFO: `/v3/projects/59c3f705e3f142d5808c0521e4085c8c` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.180914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c3f705e3f142d5808c0521e4085c8c)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.183496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.206911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 946/1859] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:42 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:42.210978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157662d-526a-41b9-a971-82018ea2f3a0 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.213574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0157662d-526a-41b9-a971-82018ea2f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:42.231836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157662d-526a-41b9-a971-82018ea2f3a0 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.253295 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c3f705e3f142d5808c0521e4085c8c', 'request_id': 'req-23a691fa-d225-44ab-930a-ea956b2013d4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:42.263539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c3f705e3f142d5808c0521e4085c8c', 'request_id': 'req-23a691fa-d225-44ab-930a-ea956b2013d4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:42.272882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c3f705e3f142d5808c0521e4085c8c', 'request_id': 'req-23a691fa-d225-44ab-930a-ea956b2013d4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:42.308771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] The token cache is being invalidate because project 59c3f705e3f142d5808c0521e4085c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:42.311069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:42.312001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-23a691fa-d225-44ab-930a-ea956b2013d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:42.314471 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 914/1860] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:42 2021] DELETE /identity/v3/projects/59c3f705e3f142d5808c0521e4085c8c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:42.321581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535793b6-b3d9-4a0a-87d4-e6bb6dc27b20 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.322089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535793b6-b3d9-4a0a-87d4-e6bb6dc27b20 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.322356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535793b6-b3d9-4a0a-87d4-e6bb6dc27b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.349781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-535793b6-b3d9-4a0a-87d4-e6bb6dc27b20 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:42.351516 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-535793b6-b3d9-4a0a-87d4-e6bb6dc27b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:42.401306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5ba99-63e1-4d94-bb17-87a1df4a100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.402050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5ba99-63e1-4d94-bb17-87a1df4a100e admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.402339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5ba99-63e1-4d94-bb17-87a1df4a100e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.402614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5ba99-63e1-4d94-bb17-87a1df4a100e admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.403377 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5ba99-63e1-4d94-bb17-87a1df4a100e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.405394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5ba99-63e1-4d94-bb17-87a1df4a100e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.451113 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 915/1861] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:42.460340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7266bda-b7a9-46d3-a795-8b3defd416fd None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.460976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7266bda-b7a9-46d3-a795-8b3defd416fd None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.461557 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7266bda-b7a9-46d3-a795-8b3defd416fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.462740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 947/1862] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:42 2021] POST /identity/v3/projects => generated 371 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:42.466382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5ba99-63e1-4d94-bb17-87a1df4a100e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.468483 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d8f5ba99-63e1-4d94-bb17-87a1df4a100e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:42.491825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a7266bda-b7a9-46d3-a795-8b3defd416fd None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:42.493692 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a7266bda-b7a9-46d3-a795-8b3defd416fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:42.558418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5ba99-63e1-4d94-bb17-87a1df4a100e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.564069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3ea5b-bbf5-4ca1-ad9b-d8af2599c9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.564936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3ea5b-bbf5-4ca1-ad9b-d8af2599c9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.565287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3ea5b-bbf5-4ca1-ad9b-d8af2599c9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.565624 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3ea5b-bbf5-4ca1-ad9b-d8af2599c9c8 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.569337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 916/1863] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:42.569490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3ea5b-bbf5-4ca1-ad9b-d8af2599c9c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.569490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3ea5b-bbf5-4ca1-ad9b-d8af2599c9c8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.570399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7266bda-b7a9-46d3-a795-8b3defd416fd None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.580306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7266bda-b7a9-46d3-a795-8b3defd416fd None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.585928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e9845-77cc-4e75-9f57-a8af574657dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.586510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e9845-77cc-4e75-9f57-a8af574657dc admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.586838 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e9845-77cc-4e75-9f57-a8af574657dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.587097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e9845-77cc-4e75-9f57-a8af574657dc admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.587826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e9845-77cc-4e75-9f57-a8af574657dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:42.588128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e9845-77cc-4e75-9f57-a8af574657dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.589712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e9845-77cc-4e75-9f57-a8af574657dc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.602548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 917/1864] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:27:42.606473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 948/1865] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:42 2021] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:42.607583 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e9845-77cc-4e75-9f57-a8af574657dc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.610373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3ea5b-bbf5-4ca1-ad9b-d8af2599c9c8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.619819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e9845-77cc-4e75-9f57-a8af574657dc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.621975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3ea5b-bbf5-4ca1-ad9b-d8af2599c9c8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.627074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d753e5-45ae-4014-8328-74aabad7517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.627668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e5f9c-a74e-47d0-9d66-f4a340af357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.627794 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d753e5-45ae-4014-8328-74aabad7517c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.628015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d753e5-45ae-4014-8328-74aabad7517c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.628296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d753e5-45ae-4014-8328-74aabad7517c admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.628842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e5f9c-a74e-47d0-9d66-f4a340af357c admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.629055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d753e5-45ae-4014-8328-74aabad7517c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.629357 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e5f9c-a74e-47d0-9d66-f4a340af357c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.629731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e5f9c-a74e-47d0-9d66-f4a340af357c admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.630510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e5f9c-a74e-47d0-9d66-f4a340af357c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.630636 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d753e5-45ae-4014-8328-74aabad7517c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.633734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e5f9c-a74e-47d0-9d66-f4a340af357c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.648810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 949/1866] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:42 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:42.652911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d753e5-45ae-4014-8328-74aabad7517c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.663422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d753e5-45ae-4014-8328-74aabad7517c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.666941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 918/1867] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:42 2021] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:42.668729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a626240-7db7-47b7-b2fe-22ed8d4d7217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.669716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a626240-7db7-47b7-b2fe-22ed8d4d7217 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.670013 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a626240-7db7-47b7-b2fe-22ed8d4d7217 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.670297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a626240-7db7-47b7-b2fe-22ed8d4d7217 admin admin] PATH_INFO: `/v3/projects/87aac383d1fa44459afbfc92264d72f3/users/1272fcc049dd49b584baa7df13b3129a/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.671079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e5f9c-a74e-47d0-9d66-f4a340af357c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.686965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a626240-7db7-47b7-b2fe-22ed8d4d7217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87aac383d1fa44459afbfc92264d72f3, user_id=1272fcc049dd49b584baa7df13b3129a, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.689803 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a626240-7db7-47b7-b2fe-22ed8d4d7217 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.711869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 950/1868] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:42 2021] PUT /identity/v3/projects/87aac383d1fa44459afbfc92264d72f3/users/1272fcc049dd49b584baa7df13b3129a/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:42.716231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a626240-7db7-47b7-b2fe-22ed8d4d7217 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.737220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e5f9c-a74e-47d0-9d66-f4a340af357c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.791847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a626240-7db7-47b7-b2fe-22ed8d4d7217 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.797203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6f37f-6da4-4250-8b9b-679a0f1a794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.797918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6f37f-6da4-4250-8b9b-679a0f1a794d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.798796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6f37f-6da4-4250-8b9b-679a0f1a794d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.799084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6f37f-6da4-4250-8b9b-679a0f1a794d admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.799987 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6f37f-6da4-4250-8b9b-679a0f1a794d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.801627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6f37f-6da4-4250-8b9b-679a0f1a794d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.814164 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 951/1869] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:42 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:42.818065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb3206-6f87-4ce1-8566-f2058c918c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.818065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3206-6f87-4ce1-8566-f2058c918c64 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.818065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3206-6f87-4ce1-8566-f2058c918c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.818065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb3206-6f87-4ce1-8566-f2058c918c64 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.818341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb3206-6f87-4ce1-8566-f2058c918c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.821695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6f37f-6da4-4250-8b9b-679a0f1a794d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.822444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb3206-6f87-4ce1-8566-f2058c918c64 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.838051 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6f37f-6da4-4250-8b9b-679a0f1a794d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.844210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453c816-266f-494c-9981-0e86f7819709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.845231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453c816-266f-494c-9981-0e86f7819709 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.845627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453c816-266f-494c-9981-0e86f7819709 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.846134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 919/1870] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:42 2021] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:42.846252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453c816-266f-494c-9981-0e86f7819709 admin admin] PATH_INFO: `/v3/projects/87aac383d1fa44459afbfc92264d72f3/users/1272fcc049dd49b584baa7df13b3129a/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.848522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453c816-266f-494c-9981-0e86f7819709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87aac383d1fa44459afbfc92264d72f3, user_id=1272fcc049dd49b584baa7df13b3129a, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.850111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb3206-6f87-4ce1-8566-f2058c918c64 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.851777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453c816-266f-494c-9981-0e86f7819709 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.860606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb3206-6f87-4ce1-8566-f2058c918c64 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.863206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 952/1871] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:42 2021] PUT /identity/v3/projects/87aac383d1fa44459afbfc92264d72f3/users/1272fcc049dd49b584baa7df13b3129a/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:42.924985 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431907f-9456-442e-b0e6-7ec3f8ac455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.926164 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431907f-9456-442e-b0e6-7ec3f8ac455c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.926521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431907f-9456-442e-b0e6-7ec3f8ac455c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.926915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431907f-9456-442e-b0e6-7ec3f8ac455c admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.927720 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431907f-9456-442e-b0e6-7ec3f8ac455c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.929519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431907f-9456-442e-b0e6-7ec3f8ac455c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.940073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 920/1872] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:42 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:42.944496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453c816-266f-494c-9981-0e86f7819709 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:42.962869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453c816-266f-494c-9981-0e86f7819709 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:42.968546 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598ef01-3be3-4dfe-8e2d-490089c786d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:42.969436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598ef01-3be3-4dfe-8e2d-490089c786d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:42.969870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598ef01-3be3-4dfe-8e2d-490089c786d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:42.970504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598ef01-3be3-4dfe-8e2d-490089c786d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:42.971796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598ef01-3be3-4dfe-8e2d-490089c786d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:42.976689 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598ef01-3be3-4dfe-8e2d-490089c786d6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:42.990495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 953/1873] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:42 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:42.994417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431907f-9456-442e-b0e6-7ec3f8ac455c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:43.010736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431907f-9456-442e-b0e6-7ec3f8ac455c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:43.020956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e120edb-382e-41a9-bece-ed72522f83fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:43.021870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e120edb-382e-41a9-bece-ed72522f83fb admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:43.022144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e120edb-382e-41a9-bece-ed72522f83fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:43.025726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e120edb-382e-41a9-bece-ed72522f83fb admin admin] PATH_INFO: `/v3/projects/2becd3cd5ce94119b1e0ce82a6daaee1/users/d8406ca3cb074399bf223d3ab511c83e/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:43.057026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e120edb-382e-41a9-bece-ed72522f83fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2becd3cd5ce94119b1e0ce82a6daaee1, user_id=d8406ca3cb074399bf223d3ab511c83e, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:43.061951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e120edb-382e-41a9-bece-ed72522f83fb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:43.098918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 921/1874] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:42 2021] PUT /identity/v3/projects/2becd3cd5ce94119b1e0ce82a6daaee1/users/d8406ca3cb074399bf223d3ab511c83e/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:43.112209 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91ae5d-cf16-4599-8c52-3035e74855e9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:43.112802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91ae5d-cf16-4599-8c52-3035e74855e9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:43.113298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91ae5d-cf16-4599-8c52-3035e74855e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:43.153473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2f91ae5d-cf16-4599-8c52-3035e74855e9 None None] MFA Rules not processed for user `d8406ca3cb074399bf223d3ab511c83e`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:43.154983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2f91ae5d-cf16-4599-8c52-3035e74855e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:43.267468 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 954/1875] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:43 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:43.278087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e120edb-382e-41a9-bece-ed72522f83fb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:43.280230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7e120edb-382e-41a9-bece-ed72522f83fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:43.354226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e120edb-382e-41a9-bece-ed72522f83fb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:43.358408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb33f34-7fd1-4a9d-ad4d-989c716ae2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:43.359416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb33f34-7fd1-4a9d-ad4d-989c716ae2db service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:43.359994 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb33f34-7fd1-4a9d-ad4d-989c716ae2db service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:43.360556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb33f34-7fd1-4a9d-ad4d-989c716ae2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:43.381750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb33f34-7fd1-4a9d-ad4d-989c716ae2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:43.384313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb33f34-7fd1-4a9d-ad4d-989c716ae2db service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:43.394822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 922/1876] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:43 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:43.414602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91ae5d-cf16-4599-8c52-3035e74855e9 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:43.496495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91ae5d-cf16-4599-8c52-3035e74855e9 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:43.502410 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:43.504815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:43.505353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:43.505727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] PATH_INFO: `/v3/users/d8406ca3cb074399bf223d3ab511c83e` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:43.507140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8406ca3cb074399bf223d3ab511c83e)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:43.509173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:43.564818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8406ca3cb074399bf223d3ab511c83e'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:43.582006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8406ca3cb074399bf223d3ab511c83e'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:43.583395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8406ca3cb074399bf223d3ab511c83e'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:43.592109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8406ca3cb074399bf223d3ab511c83e'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:43.592884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8406ca3cb074399bf223d3ab511c83e'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:43.606137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 955/1877] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:43 2021] DELETE /identity/v3/users/d8406ca3cb074399bf223d3ab511c83e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:43.610954 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4318f-6c51-4c81-af5d-84eeb29c0427 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:43.611285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4318f-6c51-4c81-af5d-84eeb29c0427 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:43.611574 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4318f-6c51-4c81-af5d-84eeb29c0427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:43.636874 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-efa4318f-6c51-4c81-af5d-84eeb29c0427 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:43.638370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-efa4318f-6c51-4c81-af5d-84eeb29c0427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:43.726486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 923/1878] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:43.736842 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:43.739104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:43.780255 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ea1da-8690-41df-8202-de591054af3e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:43.780554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ea1da-8690-41df-8202-de591054af3e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:43.780930 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ea1da-8690-41df-8202-de591054af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:43.815622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-f51ea1da-8690-41df-8202-de591054af3e None None] MFA Rules not processed for user `1272fcc049dd49b584baa7df13b3129a`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:43.817278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16fc98-4d65-4d7e-90e9-fa7acc27384c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:43.818780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f51ea1da-8690-41df-8202-de591054af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:43.823786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636c3b9-d026-43df-bdc9-a210233f02c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:43.824816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c3b9-d026-43df-bdc9-a210233f02c6 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:43.825142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c3b9-d026-43df-bdc9-a210233f02c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:43.825532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c3b9-d026-43df-bdc9-a210233f02c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:43.840041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636c3b9-d026-43df-bdc9-a210233f02c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:43.841669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636c3b9-d026-43df-bdc9-a210233f02c6 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:43.855769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 956/1879] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:43.918757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 924/1880] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:43 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:43.927398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636c3b9-d026-43df-bdc9-a210233f02c6 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:43.928863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d636c3b9-d026-43df-bdc9-a210233f02c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:44.006125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636c3b9-d026-43df-bdc9-a210233f02c6 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:44.010102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfad470-7519-401c-8cbc-21cbfdd93558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:44.010800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfad470-7519-401c-8cbc-21cbfdd93558 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:44.011087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfad470-7519-401c-8cbc-21cbfdd93558 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:44.011360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfad470-7519-401c-8cbc-21cbfdd93558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:44.013206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4dfad470-7519-401c-8cbc-21cbfdd93558 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:44.091126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfad470-7519-401c-8cbc-21cbfdd93558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:44.092468 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfad470-7519-401c-8cbc-21cbfdd93558 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:44.103284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 957/1881] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:43 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:44.449672 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ea1da-8690-41df-8202-de591054af3e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:44.452305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f51ea1da-8690-41df-8202-de591054af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:44.489272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ea1da-8690-41df-8202-de591054af3e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:44.499108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:44.502408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:44.503018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:44.509107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] PATH_INFO: `/v3/projects/2becd3cd5ce94119b1e0ce82a6daaee1` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:44.509107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2becd3cd5ce94119b1e0ce82a6daaee1)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:44.511989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:44.630845 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2becd3cd5ce94119b1e0ce82a6daaee1', 'request_id': 'req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:44.641094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2becd3cd5ce94119b1e0ce82a6daaee1', 'request_id': 'req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:44.655752 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2becd3cd5ce94119b1e0ce82a6daaee1', 'request_id': 'req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:44.685661 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] The token cache is being invalidate because project 2becd3cd5ce94119b1e0ce82a6daaee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:44.685958 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:44.687530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cdd1cd14-1630-4f6d-9ace-9b70187c9f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:44.694759 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 925/1882] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:44 2021] DELETE /identity/v3/projects/2becd3cd5ce94119b1e0ce82a6daaee1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:44.698343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4f7d7-6204-4b5f-b3db-f52669718924 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:44.698854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4f7d7-6204-4b5f-b3db-f52669718924 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:44.698941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4f7d7-6204-4b5f-b3db-f52669718924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:44.722508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-41d4f7d7-6204-4b5f-b3db-f52669718924 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:44.724078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-41d4f7d7-6204-4b5f-b3db-f52669718924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:44.799242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 958/1883] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:44.810151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bdba3-19bc-4658-ba62-ff3e695f6c9b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:44.810474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bdba3-19bc-4658-ba62-ff3e695f6c9b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:44.811088 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bdba3-19bc-4658-ba62-ff3e695f6c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:44.843216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d41bdba3-19bc-4658-ba62-ff3e695f6c9b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:44.844761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d41bdba3-19bc-4658-ba62-ff3e695f6c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:44.853948 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 926/1884] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:44.859590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4f7d7-6204-4b5f-b3db-f52669718924 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:44.873560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4f7d7-6204-4b5f-b3db-f52669718924 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:44.880228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b9b1f-f797-4aef-8850-a9cbfdc515db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:44.881279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b9b1f-f797-4aef-8850-a9cbfdc515db admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:44.881415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b9b1f-f797-4aef-8850-a9cbfdc515db admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:44.881696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b9b1f-f797-4aef-8850-a9cbfdc515db admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:44.892470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b9b1f-f797-4aef-8850-a9cbfdc515db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:44.893009 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b9b1f-f797-4aef-8850-a9cbfdc515db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:44.895154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b9b1f-f797-4aef-8850-a9cbfdc515db admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:44.917464 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 959/1885] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:44.927317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bdba3-19bc-4658-ba62-ff3e695f6c9b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:44.936400 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bdba3-19bc-4658-ba62-ff3e695f6c9b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:44.941122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f870aa1-81c3-4071-88cd-cb2a44d26974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:44.942335 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f870aa1-81c3-4071-88cd-cb2a44d26974 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:44.942621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f870aa1-81c3-4071-88cd-cb2a44d26974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:44.942925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f870aa1-81c3-4071-88cd-cb2a44d26974 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:44.943601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f870aa1-81c3-4071-88cd-cb2a44d26974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:44.950150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f870aa1-81c3-4071-88cd-cb2a44d26974 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:44.980527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 927/1886] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:44 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:44.982043 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b9b1f-f797-4aef-8850-a9cbfdc515db admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:44.993925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b9b1f-f797-4aef-8850-a9cbfdc515db admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.063860 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a80f95-3244-4dd6-aa2d-a9b7b35e9ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.064634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a80f95-3244-4dd6-aa2d-a9b7b35e9ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.064921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a80f95-3244-4dd6-aa2d-a9b7b35e9ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.065198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a80f95-3244-4dd6-aa2d-a9b7b35e9ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.065973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a80f95-3244-4dd6-aa2d-a9b7b35e9ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.068576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a80f95-3244-4dd6-aa2d-a9b7b35e9ce7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.093589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 960/1887] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:44 2021] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:45.094795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f870aa1-81c3-4071-88cd-cb2a44d26974 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.108067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f870aa1-81c3-4071-88cd-cb2a44d26974 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.114264 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e693f8-899e-4c5d-96f2-c48a432e1372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.114923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e693f8-899e-4c5d-96f2-c48a432e1372 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.115225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e693f8-899e-4c5d-96f2-c48a432e1372 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.115513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e693f8-899e-4c5d-96f2-c48a432e1372 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.116319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e693f8-899e-4c5d-96f2-c48a432e1372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.118155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e693f8-899e-4c5d-96f2-c48a432e1372 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.132802 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 928/1888] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:45.134015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a80f95-3244-4dd6-aa2d-a9b7b35e9ce7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.145264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a80f95-3244-4dd6-aa2d-a9b7b35e9ce7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.150701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdab4aa-4090-45f5-b176-e693949252bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.151446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdab4aa-4090-45f5-b176-e693949252bf admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.151799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdab4aa-4090-45f5-b176-e693949252bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.152294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdab4aa-4090-45f5-b176-e693949252bf admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.153158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdab4aa-4090-45f5-b176-e693949252bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.154877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdab4aa-4090-45f5-b176-e693949252bf admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.169024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 961/1889] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:45.170969 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e693f8-899e-4c5d-96f2-c48a432e1372 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.179577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdab4aa-4090-45f5-b176-e693949252bf admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.182456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-dcdab4aa-4090-45f5-b176-e693949252bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:45.185370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e693f8-899e-4c5d-96f2-c48a432e1372 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.190290 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa394e8-e4b2-45f7-9b23-ac41784b3805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.191412 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa394e8-e4b2-45f7-9b23-ac41784b3805 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.191760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa394e8-e4b2-45f7-9b23-ac41784b3805 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.192177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa394e8-e4b2-45f7-9b23-ac41784b3805 admin admin] PATH_INFO: `/v3/projects/26a0d021f2de47afa417d81a682eba77/users/6eb62feecc6a4e06a25091316de6eb8a/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.197483 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdab4aa-4090-45f5-b176-e693949252bf admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.202854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.203736 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.204022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.204290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] PATH_INFO: `/v3/users/c497d997d1964bdc9e48dbd08a5a8440` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.205462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c497d997d1964bdc9e48dbd08a5a8440)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.207480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.208956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa394e8-e4b2-45f7-9b23-ac41784b3805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a0d021f2de47afa417d81a682eba77, user_id=6eb62feecc6a4e06a25091316de6eb8a, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.211972 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa394e8-e4b2-45f7-9b23-ac41784b3805 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.228376 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 929/1890] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:45 2021] PUT /identity/v3/projects/26a0d021f2de47afa417d81a682eba77/users/6eb62feecc6a4e06a25091316de6eb8a/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:45.239502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365cad2-3807-4991-beec-0ff28b8fe016 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.239794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365cad2-3807-4991-beec-0ff28b8fe016 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.240079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365cad2-3807-4991-beec-0ff28b8fe016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.262785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c497d997d1964bdc9e48dbd08a5a8440'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:45.273786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c365cad2-3807-4991-beec-0ff28b8fe016 None None] MFA Rules not processed for user `6eb62feecc6a4e06a25091316de6eb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:45.275787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c365cad2-3807-4991-beec-0ff28b8fe016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:45.278850 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c497d997d1964bdc9e48dbd08a5a8440'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:45.279694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c497d997d1964bdc9e48dbd08a5a8440'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:45.292309 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c497d997d1964bdc9e48dbd08a5a8440'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:45.294817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a38139d3-f273-4da0-aaf7-c5bb104ffa3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c497d997d1964bdc9e48dbd08a5a8440'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:45.313867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 962/1891] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:45 2021] DELETE /identity/v3/users/c497d997d1964bdc9e48dbd08a5a8440 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:45.318462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11343435-367c-4a5d-b944-3903b8f57258 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.319382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11343435-367c-4a5d-b944-3903b8f57258 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.319382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11343435-367c-4a5d-b944-3903b8f57258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.338996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-11343435-367c-4a5d-b944-3903b8f57258 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:45.340358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-11343435-367c-4a5d-b944-3903b8f57258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:45.355755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 930/1892] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:45 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:45.360220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365cad2-3807-4991-beec-0ff28b8fe016 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.361756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c365cad2-3807-4991-beec-0ff28b8fe016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:45.405974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 963/1893] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:45.416300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11343435-367c-4a5d-b944-3903b8f57258 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.419914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-11343435-367c-4a5d-b944-3903b8f57258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:45.433941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365cad2-3807-4991-beec-0ff28b8fe016 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.438685 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fd1e9-6893-4a6b-bd7f-a5b4fecfa3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.439467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fd1e9-6893-4a6b-bd7f-a5b4fecfa3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.439820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fd1e9-6893-4a6b-bd7f-a5b4fecfa3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.440101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fd1e9-6893-4a6b-bd7f-a5b4fecfa3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.440785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fd1e9-6893-4a6b-bd7f-a5b4fecfa3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.442799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fd1e9-6893-4a6b-bd7f-a5b4fecfa3f5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.474342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 931/1894] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:45 2021] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:45.475717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fd1e9-6893-4a6b-bd7f-a5b4fecfa3f5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.494197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11343435-367c-4a5d-b944-3903b8f57258 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.548026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ad62-1446-4f5a-bd44-4fb10a45514f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.548751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ad62-1446-4f5a-bd44-4fb10a45514f service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.549031 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ad62-1446-4f5a-bd44-4fb10a45514f service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.549323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ad62-1446-4f5a-bd44-4fb10a45514f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.549450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fd1e9-6893-4a6b-bd7f-a5b4fecfa3f5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.553962 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6abcdf-91bd-4dda-8d4b-5e31a10e7d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.554620 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6abcdf-91bd-4dda-8d4b-5e31a10e7d3f admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.554928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6abcdf-91bd-4dda-8d4b-5e31a10e7d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.555202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6abcdf-91bd-4dda-8d4b-5e31a10e7d3f admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.555883 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6abcdf-91bd-4dda-8d4b-5e31a10e7d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.557820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6abcdf-91bd-4dda-8d4b-5e31a10e7d3f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.559243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78ad62-1446-4f5a-bd44-4fb10a45514f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.560729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78ad62-1446-4f5a-bd44-4fb10a45514f service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.571324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 964/1895] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:45.583005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 932/1896] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:45 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:45.586294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ad62-1446-4f5a-bd44-4fb10a45514f service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.596651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ad62-1446-4f5a-bd44-4fb10a45514f service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.604584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160c883-56cf-4b95-98f3-1375ca6aec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.605744 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c883-56cf-4b95-98f3-1375ca6aec9a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.606138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c883-56cf-4b95-98f3-1375ca6aec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.606525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c883-56cf-4b95-98f3-1375ca6aec9a admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.607723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160c883-56cf-4b95-98f3-1375ca6aec9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.609938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160c883-56cf-4b95-98f3-1375ca6aec9a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.624603 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 965/1897] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:45.628733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6abcdf-91bd-4dda-8d4b-5e31a10e7d3f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.641364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6abcdf-91bd-4dda-8d4b-5e31a10e7d3f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.653470 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9996f7-21b2-4137-934c-d60b5e34e101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.653657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160c883-56cf-4b95-98f3-1375ca6aec9a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.654589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9996f7-21b2-4137-934c-d60b5e34e101 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.654929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9996f7-21b2-4137-934c-d60b5e34e101 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.655546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9996f7-21b2-4137-934c-d60b5e34e101 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.655790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b160c883-56cf-4b95-98f3-1375ca6aec9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:45.656731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9996f7-21b2-4137-934c-d60b5e34e101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.660051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9996f7-21b2-4137-934c-d60b5e34e101 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.675285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 933/1898] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:45.679541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9996f7-21b2-4137-934c-d60b5e34e101 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.689665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9996f7-21b2-4137-934c-d60b5e34e101 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.694437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9869c20-c96d-4fd8-aa60-e8ff1cdf60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.695381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9869c20-c96d-4fd8-aa60-e8ff1cdf60f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.695666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9869c20-c96d-4fd8-aa60-e8ff1cdf60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.695940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9869c20-c96d-4fd8-aa60-e8ff1cdf60f0 admin admin] PATH_INFO: `/v3/projects/f70f92b8b8364028809de011aaf1766f/users/c620b739e189487abdb768360704ff08/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.713281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9869c20-c96d-4fd8-aa60-e8ff1cdf60f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70f92b8b8364028809de011aaf1766f, user_id=c620b739e189487abdb768360704ff08, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.716211 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9869c20-c96d-4fd8-aa60-e8ff1cdf60f0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.726847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160c883-56cf-4b95-98f3-1375ca6aec9a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.732185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 934/1899] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:45 2021] PUT /identity/v3/projects/f70f92b8b8364028809de011aaf1766f/users/c620b739e189487abdb768360704ff08/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:45.742275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e39d66-8b94-490c-bd45-9391b7281053 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.742536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e39d66-8b94-490c-bd45-9391b7281053 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.742796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e39d66-8b94-490c-bd45-9391b7281053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.781507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-61e39d66-8b94-490c-bd45-9391b7281053 None None] MFA Rules not processed for user `c620b739e189487abdb768360704ff08`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:45.783650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-61e39d66-8b94-490c-bd45-9391b7281053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:45.783803 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df13d4-51db-4a31-b0f0-37e23b108b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.784468 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df13d4-51db-4a31-b0f0-37e23b108b53 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.784780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df13d4-51db-4a31-b0f0-37e23b108b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.785111 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df13d4-51db-4a31-b0f0-37e23b108b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.787523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-53df13d4-51db-4a31-b0f0-37e23b108b53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:45.874582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df13d4-51db-4a31-b0f0-37e23b108b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.876084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df13d4-51db-4a31-b0f0-37e23b108b53 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:45.882366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 935/1900] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:45 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:45.886609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 966/1901] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:45 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:45.886771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e39d66-8b94-490c-bd45-9391b7281053 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:45.962053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e39d66-8b94-490c-bd45-9391b7281053 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:45.968200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e0f40-e9c8-4bf2-a692-01c437a67bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:45.968984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e0f40-e9c8-4bf2-a692-01c437a67bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:45.969272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e0f40-e9c8-4bf2-a692-01c437a67bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:45.969544 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e0f40-e9c8-4bf2-a692-01c437a67bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:45.970229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e0f40-e9c8-4bf2-a692-01c437a67bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:45.972577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e0f40-e9c8-4bf2-a692-01c437a67bc6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:46.006456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df13d4-51db-4a31-b0f0-37e23b108b53 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.008019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-53df13d4-51db-4a31-b0f0-37e23b108b53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:46.012107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 936/1902] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:45 2021] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:46.013396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e0f40-e9c8-4bf2-a692-01c437a67bc6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.034410 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df13d4-51db-4a31-b0f0-37e23b108b53 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:46.144221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:46.147270 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.153283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e0f40-e9c8-4bf2-a692-01c437a67bc6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:46.155023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.156840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] PATH_INFO: `/v3/projects/3a6badbb993c460185d1938f89e63a5c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.158816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c97e-dc5c-4610-a007-422c1e62c7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:46.159493 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c97e-dc5c-4610-a007-422c1e62c7cd admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.159774 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c97e-dc5c-4610-a007-422c1e62c7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.160079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c97e-dc5c-4610-a007-422c1e62c7cd admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.160611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6badbb993c460185d1938f89e63a5c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:46.161366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c97e-dc5c-4610-a007-422c1e62c7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:46.164094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c97e-dc5c-4610-a007-422c1e62c7cd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:46.165852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:46.194236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 937/1903] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:46 2021] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:46.197938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c97e-dc5c-4610-a007-422c1e62c7cd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.217296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c97e-dc5c-4610-a007-422c1e62c7cd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:46.231241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5c135-237c-4c08-b6d4-9a897ba8d5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:46.232129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5c135-237c-4c08-b6d4-9a897ba8d5ab admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.232497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5c135-237c-4c08-b6d4-9a897ba8d5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.232822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5c135-237c-4c08-b6d4-9a897ba8d5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.233779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5c135-237c-4c08-b6d4-9a897ba8d5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:46.236386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5c135-237c-4c08-b6d4-9a897ba8d5ab admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:46.261441 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 938/1904] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:46 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:46.270449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5c135-237c-4c08-b6d4-9a897ba8d5ab admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.271046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6badbb993c460185d1938f89e63a5c', 'request_id': 'req-73ea66d9-e10b-45d8-9159-db3d7f714506'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.282938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5c135-237c-4c08-b6d4-9a897ba8d5ab admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:46.284849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6badbb993c460185d1938f89e63a5c', 'request_id': 'req-73ea66d9-e10b-45d8-9159-db3d7f714506'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.301483 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6badbb993c460185d1938f89e63a5c', 'request_id': 'req-73ea66d9-e10b-45d8-9159-db3d7f714506'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.324840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] The token cache is being invalidate because project 3a6badbb993c460185d1938f89e63a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:46.326121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.328217 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.333020 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 967/1905] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:46 2021] DELETE /identity/v3/projects/3a6badbb993c460185d1938f89e63a5c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:46.339443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.341758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:46.389850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d0e09-a892-4bd5-bce6-e0ba5ce32528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:46.391141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d0e09-a892-4bd5-bce6-e0ba5ce32528 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.391471 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d0e09-a892-4bd5-bce6-e0ba5ce32528 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.391794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d0e09-a892-4bd5-bce6-e0ba5ce32528 admin admin] PATH_INFO: `/v3/projects/9d0187532de6446fa861418dff7075c4/users/27e533f5b0ea43779766dc9df73e56e9/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.414030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d0e09-a892-4bd5-bce6-e0ba5ce32528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0187532de6446fa861418dff7075c4, user_id=27e533f5b0ea43779766dc9df73e56e9, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:46.416799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d0e09-a892-4bd5-bce6-e0ba5ce32528 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:46.430440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 939/1906] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:46 2021] PUT /identity/v3/projects/9d0187532de6446fa861418dff7075c4/users/27e533f5b0ea43779766dc9df73e56e9/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:46.433574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea66d9-e10b-45d8-9159-db3d7f714506 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:46.433657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d0e09-a892-4bd5-bce6-e0ba5ce32528 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.433657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1f6d0e09-a892-4bd5-bce6-e0ba5ce32528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:46.493329 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:46.494352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.494705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.495153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] PATH_INFO: `/v3/users/0ea52fb00fd24f38bb5a4142cb76c641` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.496457 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea52fb00fd24f38bb5a4142cb76c641)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:46.498452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:46.499999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d0e09-a892-4bd5-bce6-e0ba5ce32528 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:46.511192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:46.511589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.511873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.512152 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] PATH_INFO: `/v3/users/6a854207efc34371b9487781b200ef12` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.513389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a854207efc34371b9487781b200ef12)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:46.515597 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:46.552252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea52fb00fd24f38bb5a4142cb76c641'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.565988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a854207efc34371b9487781b200ef12'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.567114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea52fb00fd24f38bb5a4142cb76c641'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.567810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea52fb00fd24f38bb5a4142cb76c641'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.574554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a854207efc34371b9487781b200ef12'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.574715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea52fb00fd24f38bb5a4142cb76c641'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.575265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a854207efc34371b9487781b200ef12'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.575569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea52fb00fd24f38bb5a4142cb76c641'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.575905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a854207efc34371b9487781b200ef12'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.584916 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d9c60e8d-7fb6-4ba5-badf-260dc98d5567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a854207efc34371b9487781b200ef12'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:46.588222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 968/1907] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:46 2021] DELETE /identity/v3/users/0ea52fb00fd24f38bb5a4142cb76c641 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:46.591641 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.593219 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:46.603186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 940/1908] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:46 2021] DELETE /identity/v3/users/6a854207efc34371b9487781b200ef12 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:46.607653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353adc-6fbe-4613-80bb-0fd0cc78c455 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.608016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353adc-6fbe-4613-80bb-0fd0cc78c455 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.608357 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353adc-6fbe-4613-80bb-0fd0cc78c455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.626398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d6353adc-6fbe-4613-80bb-0fd0cc78c455 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:46.627727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d6353adc-6fbe-4613-80bb-0fd0cc78c455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:46.677312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec3c0-c94a-48f9-81de-db6830e33384 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:46.693149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 941/1909] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:46.703702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353adc-6fbe-4613-80bb-0fd0cc78c455 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.704980 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d6353adc-6fbe-4613-80bb-0fd0cc78c455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:46.751224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeca080-4c85-4f55-bb52-40bb68d197c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:46.751930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeca080-4c85-4f55-bb52-40bb68d197c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.752264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeca080-4c85-4f55-bb52-40bb68d197c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.752624 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeca080-4c85-4f55-bb52-40bb68d197c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.753370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeca080-4c85-4f55-bb52-40bb68d197c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:46.755072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeca080-4c85-4f55-bb52-40bb68d197c3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:46.766166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 969/1910] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:46 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:46.768981 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353adc-6fbe-4613-80bb-0fd0cc78c455 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:46.770290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeca080-4c85-4f55-bb52-40bb68d197c3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.773146 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3aeca080-4c85-4f55-bb52-40bb68d197c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:46.774334 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f28b6-0064-40b1-b89d-9fdfe603fce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:46.775098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f28b6-0064-40b1-b89d-9fdfe603fce0 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.775449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f28b6-0064-40b1-b89d-9fdfe603fce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.775796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f28b6-0064-40b1-b89d-9fdfe603fce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.785934 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeca080-4c85-4f55-bb52-40bb68d197c3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:46.787920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f28b6-0064-40b1-b89d-9fdfe603fce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:46.789580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f28b6-0064-40b1-b89d-9fdfe603fce0 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:46.791649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b28d0-15f4-46b2-809c-52800da28f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:46.792996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b28d0-15f4-46b2-809c-52800da28f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.793278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b28d0-15f4-46b2-809c-52800da28f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.793555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b28d0-15f4-46b2-809c-52800da28f26 admin admin] PATH_INFO: `/v3/projects/9d0187532de6446fa861418dff7075c4/users/27e533f5b0ea43779766dc9df73e56e9/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.795629 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b28d0-15f4-46b2-809c-52800da28f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0187532de6446fa861418dff7075c4, user_id=27e533f5b0ea43779766dc9df73e56e9, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:46.799291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b28d0-15f4-46b2-809c-52800da28f26 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:46.801458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 942/1911] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:46.810596 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 970/1912] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:46 2021] PUT /identity/v3/projects/9d0187532de6446fa861418dff7075c4/users/27e533f5b0ea43779766dc9df73e56e9/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:46.821587 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3488b-69fa-481d-ba2a-ea02b9afd679 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:46.822387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3488b-69fa-481d-ba2a-ea02b9afd679 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:46.822746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3488b-69fa-481d-ba2a-ea02b9afd679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:46.850100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-95a3488b-69fa-481d-ba2a-ea02b9afd679 None None] MFA Rules not processed for user `27e533f5b0ea43779766dc9df73e56e9`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:46.851458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-95a3488b-69fa-481d-ba2a-ea02b9afd679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:46.924004 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 943/1913] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:46 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:46.935361 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b28d0-15f4-46b2-809c-52800da28f26 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.937074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-620b28d0-15f4-46b2-809c-52800da28f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:46.970640 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3488b-69fa-481d-ba2a-ea02b9afd679 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:46.973622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-95a3488b-69fa-481d-ba2a-ea02b9afd679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:47.013640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b28d0-15f4-46b2-809c-52800da28f26 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:47.021169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf5419-8e18-4c88-9475-89538bd3a3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:47.022037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf5419-8e18-4c88-9475-89538bd3a3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.022620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf5419-8e18-4c88-9475-89538bd3a3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.022893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf5419-8e18-4c88-9475-89538bd3a3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.025095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cfbf5419-8e18-4c88-9475-89538bd3a3a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:47.074636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3488b-69fa-481d-ba2a-ea02b9afd679 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:47.081465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:47.083200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.083547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.083893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] PATH_INFO: `/v3/projects/99b3095aac8c4effb28ec7a5a10c6fa1` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.085676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b3095aac8c4effb28ec7a5a10c6fa1)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:47.087700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:47.088289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf5419-8e18-4c88-9475-89538bd3a3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:47.089726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf5419-8e18-4c88-9475-89538bd3a3a6 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:47.100205 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 971/1914] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:46 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:47.141241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b3095aac8c4effb28ec7a5a10c6fa1', 'request_id': 'req-d3ef8a22-7085-4aae-817e-231a08ca8e43'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.149252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b3095aac8c4effb28ec7a5a10c6fa1', 'request_id': 'req-d3ef8a22-7085-4aae-817e-231a08ca8e43'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.155089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b3095aac8c4effb28ec7a5a10c6fa1', 'request_id': 'req-d3ef8a22-7085-4aae-817e-231a08ca8e43'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.170100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] The token cache is being invalidate because project 99b3095aac8c4effb28ec7a5a10c6fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:47.170389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.171044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.172785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 944/1915] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:46 2021] DELETE /identity/v3/projects/99b3095aac8c4effb28ec7a5a10c6fa1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:47.178384 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997086-e4a3-43e6-a55e-9a5c029aac20 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.179052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997086-e4a3-43e6-a55e-9a5c029aac20 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.179395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997086-e4a3-43e6-a55e-9a5c029aac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.197484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-f6997086-e4a3-43e6-a55e-9a5c029aac20 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:47.198918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f6997086-e4a3-43e6-a55e-9a5c029aac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:47.244249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:47.245756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:47.273587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 972/1916] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:47.282819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd5c02-b8d7-4a4f-af87-902111d7f827 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.282819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd5c02-b8d7-4a4f-af87-902111d7f827 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.283203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd5c02-b8d7-4a4f-af87-902111d7f827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.306595 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7ebd5c02-b8d7-4a4f-af87-902111d7f827 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:47.308040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7ebd5c02-b8d7-4a4f-af87-902111d7f827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:47.317944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 973/1917] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:47.322588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd5c02-b8d7-4a4f-af87-902111d7f827 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:47.327690 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef8a22-7085-4aae-817e-231a08ca8e43 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:47.334283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:47.334931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd5c02-b8d7-4a4f-af87-902111d7f827 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:47.335338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.335691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.336077 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] PATH_INFO: `/v3/projects/8d455c8fed9c406b8924d6b8c3c3dd97` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.337427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d455c8fed9c406b8924d6b8c3c3dd97)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:47.339627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:47.342495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b06518-5406-4e1c-b604-c19e3a585e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:47.343398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b06518-5406-4e1c-b604-c19e3a585e1b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.343868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b06518-5406-4e1c-b604-c19e3a585e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.344383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b06518-5406-4e1c-b604-c19e3a585e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.345690 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b06518-5406-4e1c-b604-c19e3a585e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:47.346217 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b06518-5406-4e1c-b604-c19e3a585e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:47.348103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b06518-5406-4e1c-b604-c19e3a585e1b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:47.362573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 974/1918] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:47.367454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b06518-5406-4e1c-b604-c19e3a585e1b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:47.379621 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b06518-5406-4e1c-b604-c19e3a585e1b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:47.387439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ce074-1648-4886-8459-7c123d27307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:47.389259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce074-1648-4886-8459-7c123d27307b admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.389639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce074-1648-4886-8459-7c123d27307b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.389900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce074-1648-4886-8459-7c123d27307b admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.391245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ce074-1648-4886-8459-7c123d27307b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:47.397071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ce074-1648-4886-8459-7c123d27307b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:47.428484 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d455c8fed9c406b8924d6b8c3c3dd97', 'request_id': 'req-265fcf80-d0f8-4066-81c2-f1323f1d42dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.440909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d455c8fed9c406b8924d6b8c3c3dd97', 'request_id': 'req-265fcf80-d0f8-4066-81c2-f1323f1d42dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.448853 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d455c8fed9c406b8924d6b8c3c3dd97', 'request_id': 'req-265fcf80-d0f8-4066-81c2-f1323f1d42dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.453726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 975/1919] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:47 2021] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:47.455152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ce074-1648-4886-8459-7c123d27307b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:47.467752 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] The token cache is being invalidate because project 8d455c8fed9c406b8924d6b8c3c3dd97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:47.468490 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.469450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.471561 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 945/1920] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:47 2021] DELETE /identity/v3/projects/8d455c8fed9c406b8924d6b8c3c3dd97 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:47.476663 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:47.479582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:47.587541 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ce074-1648-4886-8459-7c123d27307b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:47.594464 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7c9b1-1c63-4045-97ab-cc05c4051db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:47.595182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7c9b1-1c63-4045-97ab-cc05c4051db2 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.595644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7c9b1-1c63-4045-97ab-cc05c4051db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.596074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7c9b1-1c63-4045-97ab-cc05c4051db2 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.596779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7c9b1-1c63-4045-97ab-cc05c4051db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:47.599563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7c9b1-1c63-4045-97ab-cc05c4051db2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:47.608063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fcf80-d0f8-4066-81c2-f1323f1d42dc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:47.627815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:47.627983 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.628268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.628559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] PATH_INFO: `/v3/users/833f72beb1af47dfa3bec2e22f2fff55` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.631079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=833f72beb1af47dfa3bec2e22f2fff55)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:47.633658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:47.638358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 976/1921] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:47 2021] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:47.640157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7c9b1-1c63-4045-97ab-cc05c4051db2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:47.643678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ffc7c9b1-1c63-4045-97ab-cc05c4051db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:47.659207 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7c9b1-1c63-4045-97ab-cc05c4051db2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:47.670030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24c75-a3d2-4613-8d56-9bd6cdf980c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:47.671418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24c75-a3d2-4613-8d56-9bd6cdf980c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.671568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24c75-a3d2-4613-8d56-9bd6cdf980c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.671883 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24c75-a3d2-4613-8d56-9bd6cdf980c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.673795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b24c75-a3d2-4613-8d56-9bd6cdf980c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:47.676911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b24c75-a3d2-4613-8d56-9bd6cdf980c6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:47.690195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 977/1922] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:47 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:47.694776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24c75-a3d2-4613-8d56-9bd6cdf980c6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:47.706509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24c75-a3d2-4613-8d56-9bd6cdf980c6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:47.708258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833f72beb1af47dfa3bec2e22f2fff55'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.712508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ee5e-e6ba-4faa-b3bc-1dcb8188b5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:47.713266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ee5e-e6ba-4faa-b3bc-1dcb8188b5ae admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.713836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ee5e-e6ba-4faa-b3bc-1dcb8188b5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.714058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ee5e-e6ba-4faa-b3bc-1dcb8188b5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.714959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ee5e-e6ba-4faa-b3bc-1dcb8188b5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:47.715917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833f72beb1af47dfa3bec2e22f2fff55'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.716679 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833f72beb1af47dfa3bec2e22f2fff55'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.716981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ee5e-e6ba-4faa-b3bc-1dcb8188b5ae admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:47.717296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833f72beb1af47dfa3bec2e22f2fff55'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.725995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-988c17f1-666f-4f11-9a64-166c2cbe81bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833f72beb1af47dfa3bec2e22f2fff55'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:47.728728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 978/1923] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:47 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:47.732881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ee5e-e6ba-4faa-b3bc-1dcb8188b5ae admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:47.734828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1621ee5e-e6ba-4faa-b3bc-1dcb8188b5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:47.743532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 946/1924] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:47 2021] DELETE /identity/v3/users/833f72beb1af47dfa3bec2e22f2fff55 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:47.749840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ee5e-e6ba-4faa-b3bc-1dcb8188b5ae admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:47.809740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909e487-e5fb-42b2-9068-8d95b846faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:47.810809 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e487-e5fb-42b2-9068-8d95b846faec admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.811096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e487-e5fb-42b2-9068-8d95b846faec admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.811420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909e487-e5fb-42b2-9068-8d95b846faec admin admin] PATH_INFO: `/v3/projects/bd5c2ff971ba453b813a9c984e81087a/users/5a26a0821c734d3289bc7727815ed68f/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.827916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909e487-e5fb-42b2-9068-8d95b846faec admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5c2ff971ba453b813a9c984e81087a, user_id=5a26a0821c734d3289bc7727815ed68f, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:47.830595 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909e487-e5fb-42b2-9068-8d95b846faec admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:47.845350 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 979/1925] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:47 2021] PUT /identity/v3/projects/bd5c2ff971ba453b813a9c984e81087a/users/5a26a0821c734d3289bc7727815ed68f/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:47.857278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216059ef-298f-4d6d-b96e-08f465f4e230 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:47.857710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216059ef-298f-4d6d-b96e-08f465f4e230 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:47.858114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216059ef-298f-4d6d-b96e-08f465f4e230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:47.884668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-216059ef-298f-4d6d-b96e-08f465f4e230 None None] MFA Rules not processed for user `5a26a0821c734d3289bc7727815ed68f`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:47.885901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-216059ef-298f-4d6d-b96e-08f465f4e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:47.960648 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 947/1926] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:47 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:47.962266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909e487-e5fb-42b2-9068-8d95b846faec admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.036670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909e487-e5fb-42b2-9068-8d95b846faec admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.041510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7071db7-1b9c-4664-8a5b-0bbbcf08e67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.042174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7071db7-1b9c-4664-8a5b-0bbbcf08e67e admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.042463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7071db7-1b9c-4664-8a5b-0bbbcf08e67e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.042797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7071db7-1b9c-4664-8a5b-0bbbcf08e67e admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.043499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7071db7-1b9c-4664-8a5b-0bbbcf08e67e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.045420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7071db7-1b9c-4664-8a5b-0bbbcf08e67e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.075130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216059ef-298f-4d6d-b96e-08f465f4e230 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.076579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-216059ef-298f-4d6d-b96e-08f465f4e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:48.078285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 980/1927] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:47 2021] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:48.083033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7071db7-1b9c-4664-8a5b-0bbbcf08e67e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.102018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216059ef-298f-4d6d-b96e-08f465f4e230 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.158018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7071db7-1b9c-4664-8a5b-0bbbcf08e67e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.163016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed48a5-9da3-459e-8728-7557bd20d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.163710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed48a5-9da3-459e-8728-7557bd20d1fa admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.163976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed48a5-9da3-459e-8728-7557bd20d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.164275 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed48a5-9da3-459e-8728-7557bd20d1fa admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.164926 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed48a5-9da3-459e-8728-7557bd20d1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.166951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed48a5-9da3-459e-8728-7557bd20d1fa admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.174698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.175516 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.175830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.176108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] PATH_INFO: `/v3/projects/690f607976694173a7b0f365fbe9655a` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.177375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690f607976694173a7b0f365fbe9655a)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.179301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.190429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 981/1928] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:48 2021] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:48.191959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed48a5-9da3-459e-8728-7557bd20d1fa admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.201502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed48a5-9da3-459e-8728-7557bd20d1fa admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.206193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d62fe-62dd-47f0-90ae-87fbdcf7fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.207472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d62fe-62dd-47f0-90ae-87fbdcf7fe89 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.207771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d62fe-62dd-47f0-90ae-87fbdcf7fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.208052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d62fe-62dd-47f0-90ae-87fbdcf7fe89 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.208834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d62fe-62dd-47f0-90ae-87fbdcf7fe89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.210420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d62fe-62dd-47f0-90ae-87fbdcf7fe89 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.221583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 982/1929] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:48.229687 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d62fe-62dd-47f0-90ae-87fbdcf7fe89 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.231442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690f607976694173a7b0f365fbe9655a', 'request_id': 'req-90fd952f-7803-403d-aee5-f25c0fd951f7'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:48.237660 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690f607976694173a7b0f365fbe9655a', 'request_id': 'req-90fd952f-7803-403d-aee5-f25c0fd951f7'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:48.243821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d62fe-62dd-47f0-90ae-87fbdcf7fe89 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.243926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690f607976694173a7b0f365fbe9655a', 'request_id': 'req-90fd952f-7803-403d-aee5-f25c0fd951f7'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:48.257414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] The token cache is being invalidate because project 690f607976694173a7b0f365fbe9655a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:48.257834 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:48.258472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-90fd952f-7803-403d-aee5-f25c0fd951f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:48.264713 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 948/1930] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:48 2021] DELETE /identity/v3/projects/690f607976694173a7b0f365fbe9655a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:48.265972 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb654593-754c-4bce-a7a5-70e58918f134 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.266255 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb654593-754c-4bce-a7a5-70e58918f134 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.266528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb654593-754c-4bce-a7a5-70e58918f134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.284982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-eb654593-754c-4bce-a7a5-70e58918f134 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:48.286234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-eb654593-754c-4bce-a7a5-70e58918f134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:48.302159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb76cb-65a0-49a3-a1d9-b454823bfc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.303301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb76cb-65a0-49a3-a1d9-b454823bfc69 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.303729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb76cb-65a0-49a3-a1d9-b454823bfc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.304149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb76cb-65a0-49a3-a1d9-b454823bfc69 admin admin] PATH_INFO: `/v3/projects/fc4b1adab5294921beaf77c28fb8a24e/users/9ec3413166704e50bb3d61c1024e0709/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.325008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb76cb-65a0-49a3-a1d9-b454823bfc69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4b1adab5294921beaf77c28fb8a24e, user_id=9ec3413166704e50bb3d61c1024e0709, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.327986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb76cb-65a0-49a3-a1d9-b454823bfc69 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.343142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 983/1931] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:48 2021] PUT /identity/v3/projects/fc4b1adab5294921beaf77c28fb8a24e/users/9ec3413166704e50bb3d61c1024e0709/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:48.347096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb76cb-65a0-49a3-a1d9-b454823bfc69 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.349422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-29bb76cb-65a0-49a3-a1d9-b454823bfc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:48.355611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 949/1932] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:48.357041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3497b22-3bf6-4f7a-b2ac-13c385e48f7c None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.357389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3497b22-3bf6-4f7a-b2ac-13c385e48f7c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.357808 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3497b22-3bf6-4f7a-b2ac-13c385e48f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.376767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b3497b22-3bf6-4f7a-b2ac-13c385e48f7c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:48.377955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b3497b22-3bf6-4f7a-b2ac-13c385e48f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:48.426870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb76cb-65a0-49a3-a1d9-b454823bfc69 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.432233 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e097e-98f7-4e21-b50a-c4d550aadf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.432911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e097e-98f7-4e21-b50a-c4d550aadf0f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.433202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e097e-98f7-4e21-b50a-c4d550aadf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.433485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e097e-98f7-4e21-b50a-c4d550aadf0f admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.434213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e097e-98f7-4e21-b50a-c4d550aadf0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.435865 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e097e-98f7-4e21-b50a-c4d550aadf0f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.439587 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 950/1933] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:48.444594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3497b22-3bf6-4f7a-b2ac-13c385e48f7c None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.446690 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 984/1934] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:48 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:48.450519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e097e-98f7-4e21-b50a-c4d550aadf0f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.454067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3497b22-3bf6-4f7a-b2ac-13c385e48f7c None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.459340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e485d08-8374-479c-be48-03820a129fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.459999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e485d08-8374-479c-be48-03820a129fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.460286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e485d08-8374-479c-be48-03820a129fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.460565 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e485d08-8374-479c-be48-03820a129fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.461047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e097e-98f7-4e21-b50a-c4d550aadf0f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.461292 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e485d08-8374-479c-be48-03820a129fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:48.462554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e485d08-8374-479c-be48-03820a129fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.463229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e485d08-8374-479c-be48-03820a129fb0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.472936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3a4c6-f476-4eaa-911c-6945519c672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.473882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3a4c6-f476-4eaa-911c-6945519c672c admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.474174 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3a4c6-f476-4eaa-911c-6945519c672c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.474454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3a4c6-f476-4eaa-911c-6945519c672c admin admin] PATH_INFO: `/v3/projects/fc4b1adab5294921beaf77c28fb8a24e/users/9ec3413166704e50bb3d61c1024e0709/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.476837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3a4c6-f476-4eaa-911c-6945519c672c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4b1adab5294921beaf77c28fb8a24e, user_id=9ec3413166704e50bb3d61c1024e0709, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.479426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3a4c6-f476-4eaa-911c-6945519c672c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.480984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 951/1935] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:27:48.485157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e485d08-8374-479c-be48-03820a129fb0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.491759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 985/1936] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:48 2021] PUT /identity/v3/projects/fc4b1adab5294921beaf77c28fb8a24e/users/9ec3413166704e50bb3d61c1024e0709/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:48.497545 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e485d08-8374-479c-be48-03820a129fb0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.501313 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735a7e7-3456-4ad7-9bd8-82a9c3adc438 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.501613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735a7e7-3456-4ad7-9bd8-82a9c3adc438 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.501895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735a7e7-3456-4ad7-9bd8-82a9c3adc438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.531375 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7735a7e7-3456-4ad7-9bd8-82a9c3adc438 None None] MFA Rules not processed for user `9ec3413166704e50bb3d61c1024e0709`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:48.532999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7735a7e7-3456-4ad7-9bd8-82a9c3adc438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:48.571639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276094ac-c87b-4636-99f4-1335fe849e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.572468 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276094ac-c87b-4636-99f4-1335fe849e3c admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.572758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276094ac-c87b-4636-99f4-1335fe849e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.573143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276094ac-c87b-4636-99f4-1335fe849e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.574343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276094ac-c87b-4636-99f4-1335fe849e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.576445 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276094ac-c87b-4636-99f4-1335fe849e3c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.621433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 952/1937] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:48 2021] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:48.630281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276094ac-c87b-4636-99f4-1335fe849e3c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.633904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 986/1938] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:48 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:48.645943 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735a7e7-3456-4ad7-9bd8-82a9c3adc438 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.647401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7735a7e7-3456-4ad7-9bd8-82a9c3adc438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:48.706207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276094ac-c87b-4636-99f4-1335fe849e3c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.715507 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735a7e7-3456-4ad7-9bd8-82a9c3adc438 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.717528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75505323-4c11-4ec4-8492-a51838c0d52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.718259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75505323-4c11-4ec4-8492-a51838c0d52c admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.718552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75505323-4c11-4ec4-8492-a51838c0d52c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.719303 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75505323-4c11-4ec4-8492-a51838c0d52c admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.719993 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75505323-4c11-4ec4-8492-a51838c0d52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.722116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75505323-4c11-4ec4-8492-a51838c0d52c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.751855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 953/1939] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:48 2021] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:48.757297 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75505323-4c11-4ec4-8492-a51838c0d52c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.772480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75505323-4c11-4ec4-8492-a51838c0d52c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.779862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc789-d72a-4971-a1bf-5411adca9b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.781480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc789-d72a-4971-a1bf-5411adca9b06 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.781835 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc789-d72a-4971-a1bf-5411adca9b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.782219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc789-d72a-4971-a1bf-5411adca9b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.782464 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603839d-e820-446d-a315-f1c92b30bff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.783274 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603839d-e820-446d-a315-f1c92b30bff9 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.783404 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbc789-d72a-4971-a1bf-5411adca9b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.783563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603839d-e820-446d-a315-f1c92b30bff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.783841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603839d-e820-446d-a315-f1c92b30bff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.785478 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbc789-d72a-4971-a1bf-5411adca9b06 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.798426 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 954/1940] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:48 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:48.803311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc789-d72a-4971-a1bf-5411adca9b06 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.820756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc789-d72a-4971-a1bf-5411adca9b06 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.833669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9586a0d-722c-4c9b-9402-b871c69cc7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.834347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9586a0d-722c-4c9b-9402-b871c69cc7bb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.834627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9586a0d-722c-4c9b-9402-b871c69cc7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.834926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9586a0d-722c-4c9b-9402-b871c69cc7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.835648 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9586a0d-722c-4c9b-9402-b871c69cc7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.837225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9586a0d-722c-4c9b-9402-b871c69cc7bb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.865359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 955/1941] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:48 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:48.869774 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9586a0d-722c-4c9b-9402-b871c69cc7bb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:48.883535 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9586a0d-722c-4c9b-9402-b871c69cc7bb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:48.890880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59afc1-4bbd-456a-bd41-e003167ec913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:48.892512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59afc1-4bbd-456a-bd41-e003167ec913 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.893301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59afc1-4bbd-456a-bd41-e003167ec913 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.893301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59afc1-4bbd-456a-bd41-e003167ec913 admin admin] PATH_INFO: `/v3/projects/ad59bcc0007c40efa9da664af81ca959/users/059f4f90a2754667a662e792191be981/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.894917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603839d-e820-446d-a315-f1c92b30bff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.896728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603839d-e820-446d-a315-f1c92b30bff9 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.907744 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 987/1942] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:48 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:48.913519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59afc1-4bbd-456a-bd41-e003167ec913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad59bcc0007c40efa9da664af81ca959, user_id=059f4f90a2754667a662e792191be981, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:48.916336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59afc1-4bbd-456a-bd41-e003167ec913 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:48.933939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 956/1943] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:48 2021] PUT /identity/v3/projects/ad59bcc0007c40efa9da664af81ca959/users/059f4f90a2754667a662e792191be981/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:48.947622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169316-a5b0-485a-bd21-06581b024049 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:48.947622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169316-a5b0-485a-bd21-06581b024049 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:48.947622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169316-a5b0-485a-bd21-06581b024049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:48.982342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-70169316-a5b0-485a-bd21-06581b024049 None None] MFA Rules not processed for user `059f4f90a2754667a662e792191be981`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:48.983720 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-70169316-a5b0-485a-bd21-06581b024049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:49.038817 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59afc1-4bbd-456a-bd41-e003167ec913 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:49.084512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 988/1944] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:48 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:49.109023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59afc1-4bbd-456a-bd41-e003167ec913 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:49.112858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b280d8-2e6b-4f3a-9363-6e91974e46c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:49.114058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b280d8-2e6b-4f3a-9363-6e91974e46c9 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:49.114342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b280d8-2e6b-4f3a-9363-6e91974e46c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:49.114619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b280d8-2e6b-4f3a-9363-6e91974e46c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:49.116537 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-64b280d8-2e6b-4f3a-9363-6e91974e46c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:49.152581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70169316-a5b0-485a-bd21-06581b024049 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:49.154353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-70169316-a5b0-485a-bd21-06581b024049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:49.170054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70169316-a5b0-485a-bd21-06581b024049 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:49.173830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938cfb-1e67-453a-9f05-e53de0823fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:49.174495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938cfb-1e67-453a-9f05-e53de0823fde service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:49.174940 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938cfb-1e67-453a-9f05-e53de0823fde service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:49.175064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938cfb-1e67-453a-9f05-e53de0823fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:49.186445 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938cfb-1e67-453a-9f05-e53de0823fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:49.188041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938cfb-1e67-453a-9f05-e53de0823fde service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:49.188402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b280d8-2e6b-4f3a-9363-6e91974e46c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:49.189883 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b280d8-2e6b-4f3a-9363-6e91974e46c9 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:49.197573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 989/1945] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:49 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:49.200136 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 957/1946] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:49 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:49.524086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938cfb-1e67-453a-9f05-e53de0823fde service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:49.537794 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938cfb-1e67-453a-9f05-e53de0823fde service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:49.542064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7db7d-c6f0-4b5a-ae04-9a502458e765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:49.543821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7db7d-c6f0-4b5a-ae04-9a502458e765 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:49.544179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7db7d-c6f0-4b5a-ae04-9a502458e765 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:49.544506 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7db7d-c6f0-4b5a-ae04-9a502458e765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:49.546369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2ef7db7d-c6f0-4b5a-ae04-9a502458e765 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:49.619573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7db7d-c6f0-4b5a-ae04-9a502458e765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:49.621456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7db7d-c6f0-4b5a-ae04-9a502458e765 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:49.633897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 990/1947] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:49 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:50.405984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b280d8-2e6b-4f3a-9363-6e91974e46c9 service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:50.416669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b280d8-2e6b-4f3a-9363-6e91974e46c9 service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:50.420901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c16ad-e4a9-4609-875e-c0b46cada2b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:50.421540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c16ad-e4a9-4609-875e-c0b46cada2b4 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:50.422032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c16ad-e4a9-4609-875e-c0b46cada2b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:50.422306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c16ad-e4a9-4609-875e-c0b46cada2b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:50.424459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-4d4c16ad-e4a9-4609-875e-c0b46cada2b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:50.494540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c16ad-e4a9-4609-875e-c0b46cada2b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:50.496027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c16ad-e4a9-4609-875e-c0b46cada2b4 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:50.506551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 958/1948] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:50 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:27:55.617628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7db7d-c6f0-4b5a-ae04-9a502458e765 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:55.699876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7db7d-c6f0-4b5a-ae04-9a502458e765 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:55.705292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:55.706250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:55.706630 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:55.707663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] PATH_INFO: `/v3/users/5a26a0821c734d3289bc7727815ed68f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:55.708767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a26a0821c734d3289bc7727815ed68f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:55.710951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:55.767938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a26a0821c734d3289bc7727815ed68f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:55.781210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a26a0821c734d3289bc7727815ed68f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:55.782142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a26a0821c734d3289bc7727815ed68f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:55.789712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a26a0821c734d3289bc7727815ed68f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:55.790393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a26a0821c734d3289bc7727815ed68f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:55.806780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 991/1949] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:55 2021] DELETE /identity/v3/users/5a26a0821c734d3289bc7727815ed68f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:55.809888 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4adf7-d75e-4800-8679-7bd65ee4c6bc None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:55.810299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4adf7-d75e-4800-8679-7bd65ee4c6bc None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:55.810299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4adf7-d75e-4800-8679-7bd65ee4c6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:55.835330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-fcb4adf7-d75e-4800-8679-7bd65ee4c6bc None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:55.836780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-fcb4adf7-d75e-4800-8679-7bd65ee4c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:55.925037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 959/1950] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:55.944107 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:55.947237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:56.028382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645635c5-5d07-468f-b36f-e14938bfdeb6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:56.032721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b2e4d-49b9-406f-8c11-8daaa2471ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:56.033702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2e4d-49b9-406f-8c11-8daaa2471ddc service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:56.034084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2e4d-49b9-406f-8c11-8daaa2471ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:56.034525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2e4d-49b9-406f-8c11-8daaa2471ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:56.049915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b2e4d-49b9-406f-8c11-8daaa2471ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:56.052411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b2e4d-49b9-406f-8c11-8daaa2471ddc service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:56.068837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 992/1951] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:56.475168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4adf7-d75e-4800-8679-7bd65ee4c6bc None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:56.476765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-fcb4adf7-d75e-4800-8679-7bd65ee4c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:56.494058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4adf7-d75e-4800-8679-7bd65ee4c6bc None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:56.499602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:56.500618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:56.501165 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:56.501402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] PATH_INFO: `/v3/users/6eb62feecc6a4e06a25091316de6eb8a` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:56.503330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb62feecc6a4e06a25091316de6eb8a)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:56.505617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:56.524286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b2e4d-49b9-406f-8c11-8daaa2471ddc service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:56.526480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f06b2e4d-49b9-406f-8c11-8daaa2471ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:56.541235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b2e4d-49b9-406f-8c11-8daaa2471ddc service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:56.557921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:56.558954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:56.559244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:56.559443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] PATH_INFO: `/v3/projects/bd5c2ff971ba453b813a9c984e81087a` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:56.560887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5c2ff971ba453b813a9c984e81087a)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:56.562960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:56.576603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb62feecc6a4e06a25091316de6eb8a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.583478 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb62feecc6a4e06a25091316de6eb8a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.584156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb62feecc6a4e06a25091316de6eb8a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.584778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb62feecc6a4e06a25091316de6eb8a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.592709 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-010f6853-a23d-48d3-96ec-eb666947aab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb62feecc6a4e06a25091316de6eb8a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.612290 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 960/1952] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:56 2021] DELETE /identity/v3/users/6eb62feecc6a4e06a25091316de6eb8a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:56.612488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5c2ff971ba453b813a9c984e81087a', 'request_id': 'req-db254a50-5f31-4ca3-a450-8a4f6a610a1c'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.615820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3000f-d3cc-4df5-8359-0fba2d57bdf4 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:56.616110 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3000f-d3cc-4df5-8359-0fba2d57bdf4 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:56.616389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3000f-d3cc-4df5-8359-0fba2d57bdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:56.619925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5c2ff971ba453b813a9c984e81087a', 'request_id': 'req-db254a50-5f31-4ca3-a450-8a4f6a610a1c'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.625165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5c2ff971ba453b813a9c984e81087a', 'request_id': 'req-db254a50-5f31-4ca3-a450-8a4f6a610a1c'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.633306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a5b3000f-d3cc-4df5-8359-0fba2d57bdf4 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:56.634501 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a5b3000f-d3cc-4df5-8359-0fba2d57bdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:56.637407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] The token cache is being invalidate because project bd5c2ff971ba453b813a9c984e81087a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:56.637719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.638321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.640115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 993/1953] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:56 2021] DELETE /identity/v3/projects/bd5c2ff971ba453b813a9c984e81087a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:56.643859 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:56.645808 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:56.697044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 961/1954] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:56.709102 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3000f-d3cc-4df5-8359-0fba2d57bdf4 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:56.710770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a5b3000f-d3cc-4df5-8359-0fba2d57bdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:56.719372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254a50-5f31-4ca3-a450-8a4f6a610a1c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:56.726480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:56.729224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:56.729517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:56.730210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] PATH_INFO: `/v3/users/9ec3413166704e50bb3d61c1024e0709` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:56.731916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec3413166704e50bb3d61c1024e0709)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:56.734166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:56.777267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3000f-d3cc-4df5-8359-0fba2d57bdf4 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:56.781152 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5b8f-4bd9-409b-a684-3b261844bf1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:56.781797 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5b8f-4bd9-409b-a684-3b261844bf1b service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:56.782080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5b8f-4bd9-409b-a684-3b261844bf1b service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:56.782351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5b8f-4bd9-409b-a684-3b261844bf1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:56.791188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec3413166704e50bb3d61c1024e0709'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.793067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d5b8f-4bd9-409b-a684-3b261844bf1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:56.794544 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d5b8f-4bd9-409b-a684-3b261844bf1b service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:56.803545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec3413166704e50bb3d61c1024e0709'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.804258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec3413166704e50bb3d61c1024e0709'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.806774 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 962/1955] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:56.811140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec3413166704e50bb3d61c1024e0709'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.811848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec3413166704e50bb3d61c1024e0709'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:56.826148 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 994/1956] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:56 2021] DELETE /identity/v3/users/9ec3413166704e50bb3d61c1024e0709 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:57.410085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5b8f-4bd9-409b-a684-3b261844bf1b service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:57.412732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-bb7d5b8f-4bd9-409b-a684-3b261844bf1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:57.428919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5b8f-4bd9-409b-a684-3b261844bf1b service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:57.501411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:57.502597 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:57.503050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:57.503541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] PATH_INFO: `/v3/projects/26a0d021f2de47afa417d81a682eba77` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:57.505964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a0d021f2de47afa417d81a682eba77)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:57.508138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:57.571943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a0d021f2de47afa417d81a682eba77', 'request_id': 'req-1aa8d01b-326d-46c9-9028-77fed6b876ea'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.579020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a0d021f2de47afa417d81a682eba77', 'request_id': 'req-1aa8d01b-326d-46c9-9028-77fed6b876ea'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.585074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a0d021f2de47afa417d81a682eba77', 'request_id': 'req-1aa8d01b-326d-46c9-9028-77fed6b876ea'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.605643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] The token cache is being invalidate because project 26a0d021f2de47afa417d81a682eba77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:57.606887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.607790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.609447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 963/1957] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:57 2021] DELETE /identity/v3/projects/26a0d021f2de47afa417d81a682eba77 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:57.614445 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:57.615959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:57.633397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c2ace-71a3-43f5-88c3-892c33ff7981 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:57.694536 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:57.695620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:57.695916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:57.696272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] PATH_INFO: `/v3/users/c620b739e189487abdb768360704ff08` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:57.697762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c620b739e189487abdb768360704ff08)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:57.699928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:57.734058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:57.735646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:57.749382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d01b-326d-46c9-9028-77fed6b876ea admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:57.755342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:57.755937 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c620b739e189487abdb768360704ff08'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.756201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:57.756483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:57.756769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] PATH_INFO: `/v3/projects/fc4b1adab5294921beaf77c28fb8a24e` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:57.758131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4b1adab5294921beaf77c28fb8a24e)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:57.760074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:57.772111 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c620b739e189487abdb768360704ff08'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.772959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c620b739e189487abdb768360704ff08'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.779999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c620b739e189487abdb768360704ff08'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.780658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-7c473ff2-74f9-4be3-bfa9-a09760918549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c620b739e189487abdb768360704ff08'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.798701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 995/1958] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:57 2021] DELETE /identity/v3/users/c620b739e189487abdb768360704ff08 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:57.823190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4b1adab5294921beaf77c28fb8a24e', 'request_id': 'req-f8fca9ce-7bc0-4823-903c-7420fcc8335c'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.831079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4b1adab5294921beaf77c28fb8a24e', 'request_id': 'req-f8fca9ce-7bc0-4823-903c-7420fcc8335c'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.838295 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4b1adab5294921beaf77c28fb8a24e', 'request_id': 'req-f8fca9ce-7bc0-4823-903c-7420fcc8335c'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.853097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] The token cache is being invalidate because project fc4b1adab5294921beaf77c28fb8a24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:57.853467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.854209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f8fca9ce-7bc0-4823-903c-7420fcc8335c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:57.855901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 964/1959] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:57 2021] DELETE /identity/v3/projects/fc4b1adab5294921beaf77c28fb8a24e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:57.862177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8192c-4abf-45fb-a8e0-83a4435c353e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:57.862500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8192c-4abf-45fb-a8e0-83a4435c353e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:57.863440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8192c-4abf-45fb-a8e0-83a4435c353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:57.885717 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b2b8192c-4abf-45fb-a8e0-83a4435c353e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:57.887095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b2b8192c-4abf-45fb-a8e0-83a4435c353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:57.911341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc697c97-a619-4870-8812-5f2e5c188d70 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:57.911895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc697c97-a619-4870-8812-5f2e5c188d70 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:57.912216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc697c97-a619-4870-8812-5f2e5c188d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:57.932092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-bc697c97-a619-4870-8812-5f2e5c188d70 None None] MFA Rules not processed for user `d2f7490ad6cf4bed96cfec8a39a65b43`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:57.933359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-bc697c97-a619-4870-8812-5f2e5c188d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:57.950733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 996/1960] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:57.958338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217ca2-2c52-42ab-a01c-d11a1a545ede None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:57.958976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217ca2-2c52-42ab-a01c-d11a1a545ede None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:57.958976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217ca2-2c52-42ab-a01c-d11a1a545ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:57.990554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-41217ca2-2c52-42ab-a01c-d11a1a545ede None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:57.993398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-41217ca2-2c52-42ab-a01c-d11a1a545ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:58.002905 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 997/1961] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:58.003987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 965/1962] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:57 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:58.004109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217ca2-2c52-42ab-a01c-d11a1a545ede None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.005565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-41217ca2-2c52-42ab-a01c-d11a1a545ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:58.008504 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc697c97-a619-4870-8812-5f2e5c188d70 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.018034 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217ca2-2c52-42ab-a01c-d11a1a545ede None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:58.019427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc697c97-a619-4870-8812-5f2e5c188d70 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:58.023744 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:58.025063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.025425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.025583 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23363082-b9c6-4d84-8a9e-73733a644a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:58.025866 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] PATH_INFO: `/v3/users/059f4f90a2754667a662e792191be981` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.026376 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23363082-b9c6-4d84-8a9e-73733a644a42 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.026964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23363082-b9c6-4d84-8a9e-73733a644a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.027312 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23363082-b9c6-4d84-8a9e-73733a644a42 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.027436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059f4f90a2754667a662e792191be981)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:58.028170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23363082-b9c6-4d84-8a9e-73733a644a42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:58.028551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23363082-b9c6-4d84-8a9e-73733a644a42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:58.029756 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:58.030267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23363082-b9c6-4d84-8a9e-73733a644a42 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:58.043961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 966/1963] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:27:58.047900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23363082-b9c6-4d84-8a9e-73733a644a42 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.060680 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23363082-b9c6-4d84-8a9e-73733a644a42 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:58.066953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a5c75-b759-4fb8-ab40-8424da714e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:58.067940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5c75-b759-4fb8-ab40-8424da714e08 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.067940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5c75-b759-4fb8-ab40-8424da714e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.068116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5c75-b759-4fb8-ab40-8424da714e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.068842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a5c75-b759-4fb8-ab40-8424da714e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:58.070743 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a5c75-b759-4fb8-ab40-8424da714e08 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:58.095285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059f4f90a2754667a662e792191be981'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.099734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 967/1964] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:58 2021] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:58.103683 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a5c75-b759-4fb8-ab40-8424da714e08 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.109054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059f4f90a2754667a662e792191be981'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.109938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059f4f90a2754667a662e792191be981'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.117577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059f4f90a2754667a662e792191be981'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.118425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3b95ffe5-2653-4c13-9f98-1311996622c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059f4f90a2754667a662e792191be981'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.133126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 998/1965] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:58 2021] DELETE /identity/v3/users/059f4f90a2754667a662e792191be981 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:58.137450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadba18-2418-46ea-b3cc-8a0dfccb9d9b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.137747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadba18-2418-46ea-b3cc-8a0dfccb9d9b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.138026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadba18-2418-46ea-b3cc-8a0dfccb9d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.157250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-2cadba18-2418-46ea-b3cc-8a0dfccb9d9b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:58.158581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2cadba18-2418-46ea-b3cc-8a0dfccb9d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:58.171509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a5c75-b759-4fb8-ab40-8424da714e08 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:58.231869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 999/1966] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:27:58.232572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb105de-0a03-49b6-a281-2aa50b9fe3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:58.232699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadba18-2418-46ea-b3cc-8a0dfccb9d9b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.233828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb105de-0a03-49b6-a281-2aa50b9fe3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.234364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb105de-0a03-49b6-a281-2aa50b9fe3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.234771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb105de-0a03-49b6-a281-2aa50b9fe3b7 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.235658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb105de-0a03-49b6-a281-2aa50b9fe3b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:58.238146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb105de-0a03-49b6-a281-2aa50b9fe3b7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:58.243857 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2cadba18-2418-46ea-b3cc-8a0dfccb9d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:58.262106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 968/1967] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:58 2021] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:27:58.263195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb105de-0a03-49b6-a281-2aa50b9fe3b7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.265431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-adb105de-0a03-49b6-a281-2aa50b9fe3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:58.267291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadba18-2418-46ea-b3cc-8a0dfccb9d9b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:58.275069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:58.276063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.276348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.276626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] PATH_INFO: `/v3/projects/f70f92b8b8364028809de011aaf1766f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.277792 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70f92b8b8364028809de011aaf1766f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:58.279857 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:58.326818 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb105de-0a03-49b6-a281-2aa50b9fe3b7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:58.332611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70f92b8b8364028809de011aaf1766f', 'request_id': 'req-3ca658a0-826f-468c-b864-b41ceb464cc2'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.338760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70f92b8b8364028809de011aaf1766f', 'request_id': 'req-3ca658a0-826f-468c-b864-b41ceb464cc2'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.344863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70f92b8b8364028809de011aaf1766f', 'request_id': 'req-3ca658a0-826f-468c-b864-b41ceb464cc2'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.363947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] The token cache is being invalidate because project f70f92b8b8364028809de011aaf1766f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:58.364357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.366928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.368605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1000/1968] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:58 2021] DELETE /identity/v3/projects/f70f92b8b8364028809de011aaf1766f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:58.369467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.371871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:58.399311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb2a40-0081-44ce-9b45-57bf6b2b42eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:58.400278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb2a40-0081-44ce-9b45-57bf6b2b42eb service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.400556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb2a40-0081-44ce-9b45-57bf6b2b42eb service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.400837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb2a40-0081-44ce-9b45-57bf6b2b42eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.402899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b9cb2a40-0081-44ce-9b45-57bf6b2b42eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:58.476395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca658a0-826f-468c-b864-b41ceb464cc2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:58.481780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b81b1-6ce2-4a81-baeb-ac1e53811c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:58.482566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b81b1-6ce2-4a81-baeb-ac1e53811c47 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.489037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb2a40-0081-44ce-9b45-57bf6b2b42eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:58.490634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb2a40-0081-44ce-9b45-57bf6b2b42eb service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:58.491775 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b81b1-6ce2-4a81-baeb-ac1e53811c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.492227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b81b1-6ce2-4a81-baeb-ac1e53811c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.493082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b81b1-6ce2-4a81-baeb-ac1e53811c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:58.495314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b81b1-6ce2-4a81-baeb-ac1e53811c47 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:58.501552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 969/1969] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:27:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:27:58.504191 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb2a40-0081-44ce-9b45-57bf6b2b42eb service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.505959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b9cb2a40-0081-44ce-9b45-57bf6b2b42eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:58.520305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1001/1970] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:58 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:58.524132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b81b1-6ce2-4a81-baeb-ac1e53811c47 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.524623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb2a40-0081-44ce-9b45-57bf6b2b42eb service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:58.529646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:58.530941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.531318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.531687 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] PATH_INFO: `/v3/users/27e533f5b0ea43779766dc9df73e56e9` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.533559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e533f5b0ea43779766dc9df73e56e9)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:58.534515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b81b1-6ce2-4a81-baeb-ac1e53811c47 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:58.536286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:58.542832 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88487-acb1-42de-93a2-fb05828c0ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:58.548165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88487-acb1-42de-93a2-fb05828c0ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.548631 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88487-acb1-42de-93a2-fb05828c0ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.549091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88487-acb1-42de-93a2-fb05828c0ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.551191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b88487-acb1-42de-93a2-fb05828c0ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:58.555064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b88487-acb1-42de-93a2-fb05828c0ed0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:58.576522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1002/1971] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:58 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:27:58.578306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88487-acb1-42de-93a2-fb05828c0ed0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.591708 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88487-acb1-42de-93a2-fb05828c0ed0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:58.629521 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6631ee3-83a7-4d80-bfe0-5c2320555a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:58.633646 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6631ee3-83a7-4d80-bfe0-5c2320555a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.634231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6631ee3-83a7-4d80-bfe0-5c2320555a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.634231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6631ee3-83a7-4d80-bfe0-5c2320555a37 admin admin] PATH_INFO: `/v3/projects/1c6a46987d7d48de8fd42014f41e16ba/users/413167515ebc4768b4b9d2fe6b231d7a/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.637690 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e533f5b0ea43779766dc9df73e56e9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.666045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e533f5b0ea43779766dc9df73e56e9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.667115 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e533f5b0ea43779766dc9df73e56e9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.668639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e533f5b0ea43779766dc9df73e56e9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.690772 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8ae0ff6d-01c7-469c-b56e-ba81625f4bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e533f5b0ea43779766dc9df73e56e9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:58.692746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6631ee3-83a7-4d80-bfe0-5c2320555a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6a46987d7d48de8fd42014f41e16ba, user_id=413167515ebc4768b4b9d2fe6b231d7a, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:58.704720 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6631ee3-83a7-4d80-bfe0-5c2320555a37 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:58.714122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 970/1972] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:27:58 2021] DELETE /identity/v3/users/27e533f5b0ea43779766dc9df73e56e9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:58.739210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1003/1973] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:58 2021] PUT /identity/v3/projects/1c6a46987d7d48de8fd42014f41e16ba/users/413167515ebc4768b4b9d2fe6b231d7a/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:58.754854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419c911-9b70-41a0-a104-6a134c5690da None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:58.754854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419c911-9b70-41a0-a104-6a134c5690da None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:58.754854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419c911-9b70-41a0-a104-6a134c5690da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:58.828044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-6419c911-9b70-41a0-a104-6a134c5690da None None] MFA Rules not processed for user `413167515ebc4768b4b9d2fe6b231d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:58.829349 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6419c911-9b70-41a0-a104-6a134c5690da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:58.990977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 971/1974] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:58 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:58.995617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6631ee3-83a7-4d80-bfe0-5c2320555a37 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:58.998458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f6631ee3-83a7-4d80-bfe0-5c2320555a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:59.043592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419c911-9b70-41a0-a104-6a134c5690da None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.045396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6419c911-9b70-41a0-a104-6a134c5690da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:59.127074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6631ee3-83a7-4d80-bfe0-5c2320555a37 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.151248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9c7fb-31d1-4188-82cb-93d063d2417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.152090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9c7fb-31d1-4188-82cb-93d063d2417e admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.152593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9c7fb-31d1-4188-82cb-93d063d2417e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.154195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9c7fb-31d1-4188-82cb-93d063d2417e admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.155412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9c7fb-31d1-4188-82cb-93d063d2417e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.158499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9c7fb-31d1-4188-82cb-93d063d2417e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.210288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1004/1975] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:58 2021] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:59.211299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9c7fb-31d1-4188-82cb-93d063d2417e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.304908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419c911-9b70-41a0-a104-6a134c5690da None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.326136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9c7fb-31d1-4188-82cb-93d063d2417e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.333459 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5ef8f-dae7-426d-ac60-a4ac9aa7acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.334437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5ef8f-dae7-426d-ac60-a4ac9aa7acc5 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.334939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5ef8f-dae7-426d-ac60-a4ac9aa7acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.335104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5ef8f-dae7-426d-ac60-a4ac9aa7acc5 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.335915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5ef8f-dae7-426d-ac60-a4ac9aa7acc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.338021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5ef8f-dae7-426d-ac60-a4ac9aa7acc5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.360125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1005/1976] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:59 2021] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:59.361274 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5ef8f-dae7-426d-ac60-a4ac9aa7acc5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.365385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e4e5ef8f-dae7-426d-ac60-a4ac9aa7acc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:59.384496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5ef8f-dae7-426d-ac60-a4ac9aa7acc5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.388359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.389503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.389788 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.390069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] PATH_INFO: `/v3/projects/ad59bcc0007c40efa9da664af81ca959` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.390191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.391269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.391398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad59bcc0007c40efa9da664af81ca959)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.391721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.392098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] PATH_INFO: `/v3/projects/9d0187532de6446fa861418dff7075c4` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.393175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.393483 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d0187532de6446fa861418dff7075c4)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.396146 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.442602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad59bcc0007c40efa9da664af81ca959', 'request_id': 'req-3e606694-8a17-4907-8477-a61cb7cf025f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:59.443375 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d0187532de6446fa861418dff7075c4', 'request_id': 'req-d5d0b030-a441-4a77-8688-98af627fc197'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:59.449021 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad59bcc0007c40efa9da664af81ca959', 'request_id': 'req-3e606694-8a17-4907-8477-a61cb7cf025f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:59.451045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d0187532de6446fa861418dff7075c4', 'request_id': 'req-d5d0b030-a441-4a77-8688-98af627fc197'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:59.458847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d0187532de6446fa861418dff7075c4', 'request_id': 'req-d5d0b030-a441-4a77-8688-98af627fc197'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:59.459675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad59bcc0007c40efa9da664af81ca959', 'request_id': 'req-3e606694-8a17-4907-8477-a61cb7cf025f'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:59.474122 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] The token cache is being invalidate because project 9d0187532de6446fa861418dff7075c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:59.474414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:59.475069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:59.475675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] The token cache is being invalidate because project ad59bcc0007c40efa9da664af81ca959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:27:59.475972 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:59.480805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1006/1977] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:59 2021] DELETE /identity/v3/projects/9d0187532de6446fa861418dff7075c4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:59.480970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3e606694-8a17-4907-8477-a61cb7cf025f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:27:59.481050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.481050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:59.482086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 972/1978] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:27:59 2021] DELETE /identity/v3/projects/ad59bcc0007c40efa9da664af81ca959 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:27:59.483431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed85b0-70d5-4b24-a654-831d3149f817 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.483724 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed85b0-70d5-4b24-a654-831d3149f817 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.484006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed85b0-70d5-4b24-a654-831d3149f817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.507204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d2ed85b0-70d5-4b24-a654-831d3149f817 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:59.508506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d2ed85b0-70d5-4b24-a654-831d3149f817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:59.556334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0b030-a441-4a77-8688-98af627fc197 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.562772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3195a-4b04-4716-8306-c7b09fe6afad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.563477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3195a-4b04-4716-8306-c7b09fe6afad admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.563746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3195a-4b04-4716-8306-c7b09fe6afad admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.564032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3195a-4b04-4716-8306-c7b09fe6afad admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.564764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3195a-4b04-4716-8306-c7b09fe6afad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.566916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3195a-4b04-4716-8306-c7b09fe6afad admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.571940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 973/1979] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:59.573500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d0c41-ff23-4081-85de-06f8e18d889c None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.573881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d0c41-ff23-4081-85de-06f8e18d889c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.574253 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d0c41-ff23-4081-85de-06f8e18d889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.586372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1007/1980] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:59 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:59.587612 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf3ea-aaf0-49a8-9c5a-81cccd5426c3 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.587930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf3ea-aaf0-49a8-9c5a-81cccd5426c3 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.588313 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf3ea-aaf0-49a8-9c5a-81cccd5426c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.595044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-365d0c41-ff23-4081-85de-06f8e18d889c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:59.596267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-365d0c41-ff23-4081-85de-06f8e18d889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:59.608011 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 974/1981] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:59.615113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6faaf3ea-aaf0-49a8-9c5a-81cccd5426c3 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:59.615113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6faaf3ea-aaf0-49a8-9c5a-81cccd5426c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:59.616937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d0c41-ff23-4081-85de-06f8e18d889c None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.618553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-365d0c41-ff23-4081-85de-06f8e18d889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:59.623149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1008/1982] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:59.623149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991772-8317-4f3c-8ffe-01f282683c4e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.623149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991772-8317-4f3c-8ffe-01f282683c4e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.623149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991772-8317-4f3c-8ffe-01f282683c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.631156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d0c41-ff23-4081-85de-06f8e18d889c None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.636226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e547c-5284-4e02-a6ed-83418fd7c40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.636778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e547c-5284-4e02-a6ed-83418fd7c40c admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.637066 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e547c-5284-4e02-a6ed-83418fd7c40c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.637352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e547c-5284-4e02-a6ed-83418fd7c40c admin admin] PATH_INFO: `/v3/projects/2ba1d400574743c9ae3c2b4619e2d4f8/users/c2acf1846ed245bc998ca6660f8656cf/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.642081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-04991772-8317-4f3c-8ffe-01f282683c4e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:27:59.643405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-04991772-8317-4f3c-8ffe-01f282683c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:27:59.652205 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1009/1983] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:27:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:27:59.652417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e547c-5284-4e02-a6ed-83418fd7c40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba1d400574743c9ae3c2b4619e2d4f8, user_id=c2acf1846ed245bc998ca6660f8656cf, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.652988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04991772-8317-4f3c-8ffe-01f282683c4e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.655961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e547c-5284-4e02-a6ed-83418fd7c40c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.665677 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04991772-8317-4f3c-8ffe-01f282683c4e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.673995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 975/1984] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:59 2021] PUT /identity/v3/projects/2ba1d400574743c9ae3c2b4619e2d4f8/users/c2acf1846ed245bc998ca6660f8656cf/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:59.673995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e547c-5284-4e02-a6ed-83418fd7c40c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.730415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ac68e-5428-4c8d-b921-0886864adc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.731489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ac68e-5428-4c8d-b921-0886864adc6f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.731775 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ac68e-5428-4c8d-b921-0886864adc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.732060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ac68e-5428-4c8d-b921-0886864adc6f admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.732788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ac68e-5428-4c8d-b921-0886864adc6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:59.733102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ac68e-5428-4c8d-b921-0886864adc6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.734743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ac68e-5428-4c8d-b921-0886864adc6f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.736905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e547c-5284-4e02-a6ed-83418fd7c40c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.742183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320e6ad-e0a0-44b1-8230-ae9ca7e2a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.742878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320e6ad-e0a0-44b1-8230-ae9ca7e2a6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.743167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320e6ad-e0a0-44b1-8230-ae9ca7e2a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.743443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320e6ad-e0a0-44b1-8230-ae9ca7e2a6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.744175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320e6ad-e0a0-44b1-8230-ae9ca7e2a6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:27:59.744481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320e6ad-e0a0-44b1-8230-ae9ca7e2a6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.746092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320e6ad-e0a0-44b1-8230-ae9ca7e2a6d3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.748632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1010/1985] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:59.749642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ac68e-5428-4c8d-b921-0886864adc6f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.759361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 976/1986] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:27:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:27:59.760301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320e6ad-e0a0-44b1-8230-ae9ca7e2a6d3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.763072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ac68e-5428-4c8d-b921-0886864adc6f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.768517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19be70a-086d-4514-87c1-d7a02ea4d0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.769652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19be70a-086d-4514-87c1-d7a02ea4d0fd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.770175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19be70a-086d-4514-87c1-d7a02ea4d0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.770844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19be70a-086d-4514-87c1-d7a02ea4d0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.771314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320e6ad-e0a0-44b1-8230-ae9ca7e2a6d3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.771986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19be70a-086d-4514-87c1-d7a02ea4d0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.775711 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19be70a-086d-4514-87c1-d7a02ea4d0fd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.776001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225fecb-6c6d-4898-8797-fa8a7f4aef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.776650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225fecb-6c6d-4898-8797-fa8a7f4aef39 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.776934 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225fecb-6c6d-4898-8797-fa8a7f4aef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.777257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225fecb-6c6d-4898-8797-fa8a7f4aef39 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.778186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225fecb-6c6d-4898-8797-fa8a7f4aef39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.780098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225fecb-6c6d-4898-8797-fa8a7f4aef39 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.787375 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1011/1987] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:59 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:27:59.791720 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19be70a-086d-4514-87c1-d7a02ea4d0fd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.804908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19be70a-086d-4514-87c1-d7a02ea4d0fd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.809292 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 977/1988] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:59 2021] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:59.810056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225fecb-6c6d-4898-8797-fa8a7f4aef39 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.811406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3831cf3-1735-4f74-a102-da708dcf6609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.812244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3831cf3-1735-4f74-a102-da708dcf6609 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.812618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3831cf3-1735-4f74-a102-da708dcf6609 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.812909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3831cf3-1735-4f74-a102-da708dcf6609 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.813669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3831cf3-1735-4f74-a102-da708dcf6609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.816741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3831cf3-1735-4f74-a102-da708dcf6609 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.851541 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1012/1989] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:27:59 2021] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:59.852397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3831cf3-1735-4f74-a102-da708dcf6609 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.880912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225fecb-6c6d-4898-8797-fa8a7f4aef39 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.917030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3831cf3-1735-4f74-a102-da708dcf6609 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:27:59.922854 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d13dd0-d15e-4cd5-b303-fd2400156783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.923607 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13dd0-d15e-4cd5-b303-fd2400156783 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.923969 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13dd0-d15e-4cd5-b303-fd2400156783 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.924348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13dd0-d15e-4cd5-b303-fd2400156783 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.924963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d13dd0-d15e-4cd5-b303-fd2400156783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.927488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d13dd0-d15e-4cd5-b303-fd2400156783 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.936142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed43009-f87f-4584-9e91-6eaa8cc642e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:27:59.937122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed43009-f87f-4584-9e91-6eaa8cc642e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:27:59.937480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed43009-f87f-4584-9e91-6eaa8cc642e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:27:59.937760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed43009-f87f-4584-9e91-6eaa8cc642e2 admin admin] PATH_INFO: `/v3/projects/2ba1d400574743c9ae3c2b4619e2d4f8/users/c2acf1846ed245bc998ca6660f8656cf/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:27:59.940258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed43009-f87f-4584-9e91-6eaa8cc642e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba1d400574743c9ae3c2b4619e2d4f8, user_id=c2acf1846ed245bc998ca6660f8656cf, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:27:59.944034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed43009-f87f-4584-9e91-6eaa8cc642e2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:27:59.949465 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1013/1990] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:59 2021] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:27:59.950255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d13dd0-d15e-4cd5-b303-fd2400156783 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.955097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 978/1991] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:27:59 2021] PUT /identity/v3/projects/2ba1d400574743c9ae3c2b4619e2d4f8/users/c2acf1846ed245bc998ca6660f8656cf/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:27:59.956096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed43009-f87f-4584-9e91-6eaa8cc642e2 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:27:59.972424 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d13dd0-d15e-4cd5-b303-fd2400156783 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.030339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed43009-f87f-4584-9e91-6eaa8cc642e2 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.046797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f54ff-0948-4811-a288-582b7d407271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.047459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55138c02-ee23-4424-99d7-4e605d0610c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.047699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f54ff-0948-4811-a288-582b7d407271 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.048088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f54ff-0948-4811-a288-582b7d407271 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.048183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55138c02-ee23-4424-99d7-4e605d0610c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.048456 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55138c02-ee23-4424-99d7-4e605d0610c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.048643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f54ff-0948-4811-a288-582b7d407271 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.048748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55138c02-ee23-4424-99d7-4e605d0610c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.049453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55138c02-ee23-4424-99d7-4e605d0610c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.049563 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f54ff-0948-4811-a288-582b7d407271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.051669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55138c02-ee23-4424-99d7-4e605d0610c8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.055295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f54ff-0948-4811-a288-582b7d407271 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.063085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 979/1992] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:27:59 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:00.068056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31489a-32fe-42d9-8c60-4b982a37cf95 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.068350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31489a-32fe-42d9-8c60-4b982a37cf95 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.068674 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31489a-32fe-42d9-8c60-4b982a37cf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.093242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1014/1993] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:27:59 2021] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:00.094448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f54ff-0948-4811-a288-582b7d407271 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:00.099757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-ca31489a-32fe-42d9-8c60-4b982a37cf95 None None] MFA Rules not processed for user `c2acf1846ed245bc998ca6660f8656cf`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:00.101087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ca31489a-32fe-42d9-8c60-4b982a37cf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:00.106425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f54ff-0948-4811-a288-582b7d407271 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.111435 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a67f-f59a-4eff-80c4-fedf76681089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.112169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a67f-f59a-4eff-80c4-fedf76681089 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.112542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a67f-f59a-4eff-80c4-fedf76681089 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.112779 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a67f-f59a-4eff-80c4-fedf76681089 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.114068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524a67f-f59a-4eff-80c4-fedf76681089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.115813 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524a67f-f59a-4eff-80c4-fedf76681089 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.143617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1015/1994] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:00 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:00.144944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a67f-f59a-4eff-80c4-fedf76681089 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:00.158067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a67f-f59a-4eff-80c4-fedf76681089 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.181262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c3d11-0265-4150-9c76-e366988f6f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.183406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c3d11-0265-4150-9c76-e366988f6f5b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.183699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c3d11-0265-4150-9c76-e366988f6f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.183979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c3d11-0265-4150-9c76-e366988f6f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.184723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c3d11-0265-4150-9c76-e366988f6f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.189695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c3d11-0265-4150-9c76-e366988f6f5b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.212060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1016/1995] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:00 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:00.213001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c3d11-0265-4150-9c76-e366988f6f5b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:00.224887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c3d11-0265-4150-9c76-e366988f6f5b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.225776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 980/1996] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:00 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:00.229367 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31489a-32fe-42d9-8c60-4b982a37cf95 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:00.233556 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274b0c5-19e6-4fb9-9803-edc2f8b0d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.235015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b0c5-19e6-4fb9-9803-edc2f8b0d610 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.235702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b0c5-19e6-4fb9-9803-edc2f8b0d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.236794 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b0c5-19e6-4fb9-9803-edc2f8b0d610 admin admin] PATH_INFO: `/v3/projects/3d509ebf5e5a4a77820b0e5ea04090c5/users/f3f46b66092d4bc8956f979530a04ed4/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.255354 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274b0c5-19e6-4fb9-9803-edc2f8b0d610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d509ebf5e5a4a77820b0e5ea04090c5, user_id=f3f46b66092d4bc8956f979530a04ed4, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.255886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31489a-32fe-42d9-8c60-4b982a37cf95 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.259215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274b0c5-19e6-4fb9-9803-edc2f8b0d610 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.268337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26045fe1-80b8-4b72-aaa5-97f129b14911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.270063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26045fe1-80b8-4b72-aaa5-97f129b14911 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.270549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26045fe1-80b8-4b72-aaa5-97f129b14911 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.270916 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26045fe1-80b8-4b72-aaa5-97f129b14911 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.275073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26045fe1-80b8-4b72-aaa5-97f129b14911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.280370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26045fe1-80b8-4b72-aaa5-97f129b14911 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.288913 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1017/1997] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:00 2021] PUT /identity/v3/projects/3d509ebf5e5a4a77820b0e5ea04090c5/users/f3f46b66092d4bc8956f979530a04ed4/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:00.288913 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274b0c5-19e6-4fb9-9803-edc2f8b0d610 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:00.291799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1274b0c5-19e6-4fb9-9803-edc2f8b0d610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:00.308549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 981/1998] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:00 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:00.313889 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c7407-dc41-44af-8aa8-759fad8744ef None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.314311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c7407-dc41-44af-8aa8-759fad8744ef None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.314702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c7407-dc41-44af-8aa8-759fad8744ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.334573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-cd4c7407-dc41-44af-8aa8-759fad8744ef None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:00.335935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-cd4c7407-dc41-44af-8aa8-759fad8744ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:00.427668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274b0c5-19e6-4fb9-9803-edc2f8b0d610 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.431918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebb7c2-9e30-4038-aab4-7c082a41bf92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.432664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb7c2-9e30-4038-aab4-7c082a41bf92 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.433026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb7c2-9e30-4038-aab4-7c082a41bf92 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.433379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb7c2-9e30-4038-aab4-7c082a41bf92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.435703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 982/1999] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:00.436722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c7407-dc41-44af-8aa8-759fad8744ef None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:00.452065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c7407-dc41-44af-8aa8-759fad8744ef None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.461259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772603a1-9897-4ef5-a295-1f4d1f3092cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.462423 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772603a1-9897-4ef5-a295-1f4d1f3092cd admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.463369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772603a1-9897-4ef5-a295-1f4d1f3092cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.463816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772603a1-9897-4ef5-a295-1f4d1f3092cd admin admin] PATH_INFO: `/v3/projects/a7c8eae29e4c436d97eef86ef09220df/users/1f7499884b7d47b196ed870e139cd2c3/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.481941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772603a1-9897-4ef5-a295-1f4d1f3092cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c8eae29e4c436d97eef86ef09220df, user_id=1f7499884b7d47b196ed870e139cd2c3, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.485354 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772603a1-9897-4ef5-a295-1f4d1f3092cd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.511771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 983/2000] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:00 2021] PUT /identity/v3/projects/a7c8eae29e4c436d97eef86ef09220df/users/1f7499884b7d47b196ed870e139cd2c3/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:00.513245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772603a1-9897-4ef5-a295-1f4d1f3092cd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:00.515337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-772603a1-9897-4ef5-a295-1f4d1f3092cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:00.563409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebb7c2-9e30-4038-aab4-7c082a41bf92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.564866 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebb7c2-9e30-4038-aab4-7c082a41bf92 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.584999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1018/2001] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:00 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:00.586413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ea831-b2b1-4502-a071-300f6284a695 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.586739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ea831-b2b1-4502-a071-300f6284a695 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.587025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ea831-b2b1-4502-a071-300f6284a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.627750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772603a1-9897-4ef5-a295-1f4d1f3092cd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.634540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8d9ea831-b2b1-4502-a071-300f6284a695 None None] MFA Rules not processed for user `1f7499884b7d47b196ed870e139cd2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:00.636180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8d9ea831-b2b1-4502-a071-300f6284a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:00.638141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7afeb-f3da-4cca-83d7-db42522c3531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.640112 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7afeb-f3da-4cca-83d7-db42522c3531 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.640386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7afeb-f3da-4cca-83d7-db42522c3531 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.640664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7afeb-f3da-4cca-83d7-db42522c3531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.769769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7afeb-f3da-4cca-83d7-db42522c3531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.771279 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7afeb-f3da-4cca-83d7-db42522c3531 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.783773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 984/2002] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:00.785728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7afeb-f3da-4cca-83d7-db42522c3531 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:00.798425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7afeb-f3da-4cca-83d7-db42522c3531 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.805344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.806414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.806895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.807160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] PATH_INFO: `/v3/users/413167515ebc4768b4b9d2fe6b231d7a` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.808538 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=413167515ebc4768b4b9d2fe6b231d7a)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.811000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.842064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1019/2003] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:00 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:00.855178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ea831-b2b1-4502-a071-300f6284a695 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:00.856628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8d9ea831-b2b1-4502-a071-300f6284a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:00.897484 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413167515ebc4768b4b9d2fe6b231d7a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:00.913728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413167515ebc4768b4b9d2fe6b231d7a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:00.914700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413167515ebc4768b4b9d2fe6b231d7a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:00.915652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413167515ebc4768b4b9d2fe6b231d7a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:00.933167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-428e5d51-c9b9-402b-be9a-30401e6b24ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413167515ebc4768b4b9d2fe6b231d7a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:00.959166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ea831-b2b1-4502-a071-300f6284a695 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:00.965940 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53274fac-835a-42ea-b54b-58e1cae1e6ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b9d35e26e64c959e075622321df3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:00.966927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53274fac-835a-42ea-b54b-58e1cae1e6ed service glance] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.967265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53274fac-835a-42ea-b54b-58e1cae1e6ed service glance] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.967550 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53274fac-835a-42ea-b54b-58e1cae1e6ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.969289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 985/2004] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:00 2021] DELETE /identity/v3/users/413167515ebc4768b4b9d2fe6b231d7a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:00.969535 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-53274fac-835a-42ea-b54b-58e1cae1e6ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:00.974953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d8e8e-aa24-47f5-8892-1d541ef60137 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:00.975346 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d8e8e-aa24-47f5-8892-1d541ef60137 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:00.976097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d8e8e-aa24-47f5-8892-1d541ef60137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:00.983477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53274fac-835a-42ea-b54b-58e1cae1e6ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:00.984961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53274fac-835a-42ea-b54b-58e1cae1e6ed service glance] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:00.998068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1020/2005] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:00 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:01.027395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-5f6d8e8e-aa24-47f5-8892-1d541ef60137 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:01.028693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5f6d8e8e-aa24-47f5-8892-1d541ef60137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:01.173080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 986/2006] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:01.235983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53274fac-835a-42ea-b54b-58e1cae1e6ed service glance] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:01.237606 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-53274fac-835a-42ea-b54b-58e1cae1e6ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:01.259790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53274fac-835a-42ea-b54b-58e1cae1e6ed service glance] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:01.364245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d8e8e-aa24-47f5-8892-1d541ef60137 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:01.366827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5f6d8e8e-aa24-47f5-8892-1d541ef60137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:01.388669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d8e8e-aa24-47f5-8892-1d541ef60137 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:01.402397 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:01.403759 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:01.404046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:01.404326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] PATH_INFO: `/v3/users/9e9bbddb949d4a47a4fbd00b9d914521` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:01.405567 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9bbddb949d4a47a4fbd00b9d914521)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:01.408936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:01.416591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354df29b-c5ae-4dc5-856f-c468ea0657e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:01.417510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354df29b-c5ae-4dc5-856f-c468ea0657e4 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:01.417797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354df29b-c5ae-4dc5-856f-c468ea0657e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:01.418071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354df29b-c5ae-4dc5-856f-c468ea0657e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:01.440449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354df29b-c5ae-4dc5-856f-c468ea0657e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:01.444814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354df29b-c5ae-4dc5-856f-c468ea0657e4 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:01.469520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1021/2007] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:01.472074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9bbddb949d4a47a4fbd00b9d914521'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:01.494276 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9bbddb949d4a47a4fbd00b9d914521'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:01.495249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9bbddb949d4a47a4fbd00b9d914521'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:01.495912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9bbddb949d4a47a4fbd00b9d914521'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:01.507834 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-eaa7f072-a6cc-40e4-8167-a5c6d1c13e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9bbddb949d4a47a4fbd00b9d914521'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:01.554882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 987/2008] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:01 2021] DELETE /identity/v3/users/9e9bbddb949d4a47a4fbd00b9d914521 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:01.976524 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354df29b-c5ae-4dc5-856f-c468ea0657e4 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:01.978254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-354df29b-c5ae-4dc5-856f-c468ea0657e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:01.997236 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354df29b-c5ae-4dc5-856f-c468ea0657e4 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:02.085971 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:02.087650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:02.088268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:02.088705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] PATH_INFO: `/v3/projects/1c6a46987d7d48de8fd42014f41e16ba` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:02.090123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6a46987d7d48de8fd42014f41e16ba)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:02.092129 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:02.187221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6a46987d7d48de8fd42014f41e16ba', 'request_id': 'req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.207905 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6a46987d7d48de8fd42014f41e16ba', 'request_id': 'req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.214877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6a46987d7d48de8fd42014f41e16ba', 'request_id': 'req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.223838 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136fbb0-c822-49dc-8314-9166e5abc17e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:02.224303 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136fbb0-c822-49dc-8314-9166e5abc17e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:02.224415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136fbb0-c822-49dc-8314-9166e5abc17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:02.234004 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] The token cache is being invalidate because project 1c6a46987d7d48de8fd42014f41e16ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:02.235153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.235496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.238178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1022/2009] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:01 2021] DELETE /identity/v3/projects/1c6a46987d7d48de8fd42014f41e16ba => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:02.242795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:02.244725 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:02.292556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b136fbb0-c822-49dc-8314-9166e5abc17e None None] MFA Rules not processed for user `f3f46b66092d4bc8956f979530a04ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:02.294849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b136fbb0-c822-49dc-8314-9166e5abc17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:02.379935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68631c6-d84c-4cb9-b50d-96f5fdfb51ea admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:02.401308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:02.403091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:02.403566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:02.403988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] PATH_INFO: `/v3/users/c2acf1846ed245bc998ca6660f8656cf` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:02.405819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2acf1846ed245bc998ca6660f8656cf)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:02.408178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:02.475086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 988/2010] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:02 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:02.477773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136fbb0-c822-49dc-8314-9166e5abc17e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:02.480464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b136fbb0-c822-49dc-8314-9166e5abc17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:02.514366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2acf1846ed245bc998ca6660f8656cf'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.542778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2acf1846ed245bc998ca6660f8656cf'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.543889 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2acf1846ed245bc998ca6660f8656cf'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.566721 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136fbb0-c822-49dc-8314-9166e5abc17e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:02.576214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2acf1846ed245bc998ca6660f8656cf'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.576959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2acf1846ed245bc998ca6660f8656cf'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.577551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:02.578436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:02.578735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:02.579008 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] PATH_INFO: `/v3/projects/98f8fae0130241e28471150fe11feb81` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:02.585136 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f8fae0130241e28471150fe11feb81)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:02.587403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:02.620490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1023/2011] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:02 2021] DELETE /identity/v3/users/c2acf1846ed245bc998ca6660f8656cf => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:02.624299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:02.627723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:02.666888 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f8fae0130241e28471150fe11feb81', 'request_id': 'req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.676732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f8fae0130241e28471150fe11feb81', 'request_id': 'req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.684505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f8fae0130241e28471150fe11feb81', 'request_id': 'req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.702414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] The token cache is being invalidate because project 98f8fae0130241e28471150fe11feb81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:02.702806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.703514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2b9ca93a-11a3-4a7c-8a24-2c7031def2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:02.706737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 989/2012] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:02 2021] DELETE /identity/v3/projects/98f8fae0130241e28471150fe11feb81 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:02.712835 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59346a6d-068d-407b-97ec-2c6db42a4936 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:02.713350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59346a6d-068d-407b-97ec-2c6db42a4936 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:02.713935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59346a6d-068d-407b-97ec-2c6db42a4936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:02.714295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ca494-577e-4d9c-bc7b-e3907c378031 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:02.740149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-59346a6d-068d-407b-97ec-2c6db42a4936 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:02.741806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-59346a6d-068d-407b-97ec-2c6db42a4936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:02.777724 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190be16f-eeaf-4b40-b1fa-da8893d80c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:02.778421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190be16f-eeaf-4b40-b1fa-da8893d80c65 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:02.778709 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190be16f-eeaf-4b40-b1fa-da8893d80c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:02.778994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190be16f-eeaf-4b40-b1fa-da8893d80c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:02.780860 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-190be16f-eeaf-4b40-b1fa-da8893d80c65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:02.859025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 990/2013] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:02.860647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268aefc-2f0b-4a09-9388-0aab379dd928 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:02.860952 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268aefc-2f0b-4a09-9388-0aab379dd928 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:02.861283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268aefc-2f0b-4a09-9388-0aab379dd928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:02.882271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a268aefc-2f0b-4a09-9388-0aab379dd928 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:02.883527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a268aefc-2f0b-4a09-9388-0aab379dd928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:02.884060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190be16f-eeaf-4b40-b1fa-da8893d80c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:02.885751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190be16f-eeaf-4b40-b1fa-da8893d80c65 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:02.913033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1024/2014] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:02 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:02.923942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 991/2015] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:02.934289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190be16f-eeaf-4b40-b1fa-da8893d80c65 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:02.947948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190be16f-eeaf-4b40-b1fa-da8893d80c65 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:02.953412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95254c6-7c6d-4760-ae64-8b212cef0b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:02.954945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95254c6-7c6d-4760-ae64-8b212cef0b83 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:02.955397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95254c6-7c6d-4760-ae64-8b212cef0b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:02.955770 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95254c6-7c6d-4760-ae64-8b212cef0b83 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:02.956651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95254c6-7c6d-4760-ae64-8b212cef0b83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:02.957207 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95254c6-7c6d-4760-ae64-8b212cef0b83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:02.958818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95254c6-7c6d-4760-ae64-8b212cef0b83 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:02.971801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1025/2016] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:28:02.976387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268aefc-2f0b-4a09-9388-0aab379dd928 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:02.986503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268aefc-2f0b-4a09-9388-0aab379dd928 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:02.992263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ac4c-a38c-4b32-b518-5738cef45960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:02.993033 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ac4c-a38c-4b32-b518-5738cef45960 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:02.993439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ac4c-a38c-4b32-b518-5738cef45960 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:02.993996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ac4c-a38c-4b32-b518-5738cef45960 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:02.995214 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868ac4c-a38c-4b32-b518-5738cef45960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:02.997376 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868ac4c-a38c-4b32-b518-5738cef45960 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:03.043413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 992/2017] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:02 2021] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:03.047412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95254c6-7c6d-4760-ae64-8b212cef0b83 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:03.062600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95254c6-7c6d-4760-ae64-8b212cef0b83 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:03.147571 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd5060-19f3-40c3-80c7-08beeffa5302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:03.148326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd5060-19f3-40c3-80c7-08beeffa5302 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:03.148613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd5060-19f3-40c3-80c7-08beeffa5302 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:03.149600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd5060-19f3-40c3-80c7-08beeffa5302 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:03.150357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd5060-19f3-40c3-80c7-08beeffa5302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:03.152472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd5060-19f3-40c3-80c7-08beeffa5302 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:03.195825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1026/2018] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:03 2021] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:03.196706 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ac4c-a38c-4b32-b518-5738cef45960 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:03.210153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ac4c-a38c-4b32-b518-5738cef45960 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:03.216157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ed271-d0c5-419f-b3c0-500e09bc0413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:03.217539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ed271-d0c5-419f-b3c0-500e09bc0413 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:03.219549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ed271-d0c5-419f-b3c0-500e09bc0413 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:03.219549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ed271-d0c5-419f-b3c0-500e09bc0413 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:03.222704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ed271-d0c5-419f-b3c0-500e09bc0413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:03.224358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ed271-d0c5-419f-b3c0-500e09bc0413 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:03.244045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 993/2019] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:03 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:03.244576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd5060-19f3-40c3-80c7-08beeffa5302 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:03.258443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd5060-19f3-40c3-80c7-08beeffa5302 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:03.265007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d8c7-1f6f-4e49-9fad-39749a8b8506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:03.265938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d8c7-1f6f-4e49-9fad-39749a8b8506 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:03.266297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d8c7-1f6f-4e49-9fad-39749a8b8506 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:03.266643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d8c7-1f6f-4e49-9fad-39749a8b8506 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:03.269129 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d8c7-1f6f-4e49-9fad-39749a8b8506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:03.271050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d8c7-1f6f-4e49-9fad-39749a8b8506 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:03.290326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1027/2020] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:03 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:03.295385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ed271-d0c5-419f-b3c0-500e09bc0413 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:03.320243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ed271-d0c5-419f-b3c0-500e09bc0413 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:03.332145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5d53d-c982-4f4f-9d02-c6b93d7bcc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:03.333123 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5d53d-c982-4f4f-9d02-c6b93d7bcc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:03.333479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5d53d-c982-4f4f-9d02-c6b93d7bcc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:03.333828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5d53d-c982-4f4f-9d02-c6b93d7bcc98 admin admin] PATH_INFO: `/v3/projects/19c2b8ed86ab4cb79053fbce2835a2e0/users/5c9348a2a031476cab3d1280337b46ad/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:03.357703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5d53d-c982-4f4f-9d02-c6b93d7bcc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c2b8ed86ab4cb79053fbce2835a2e0, user_id=5c9348a2a031476cab3d1280337b46ad, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:03.361714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5d53d-c982-4f4f-9d02-c6b93d7bcc98 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:03.388283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 994/2021] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:03 2021] PUT /identity/v3/projects/19c2b8ed86ab4cb79053fbce2835a2e0/users/5c9348a2a031476cab3d1280337b46ad/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:03.444142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108182b-321b-47cc-aabf-af4a09b0eb43 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:03.444522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108182b-321b-47cc-aabf-af4a09b0eb43 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:03.445281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108182b-321b-47cc-aabf-af4a09b0eb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:03.477001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-0108182b-321b-47cc-aabf-af4a09b0eb43 None None] MFA Rules not processed for user `5c9348a2a031476cab3d1280337b46ad`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:03.478562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0108182b-321b-47cc-aabf-af4a09b0eb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:03.599966 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5d53d-c982-4f4f-9d02-c6b93d7bcc98 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:03.603366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1028/2022] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:03 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:03.606623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-56b5d53d-c982-4f4f-9d02-c6b93d7bcc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:03.614023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108182b-321b-47cc-aabf-af4a09b0eb43 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:03.616616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0108182b-321b-47cc-aabf-af4a09b0eb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:03.683041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5d53d-c982-4f4f-9d02-c6b93d7bcc98 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:03.698329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:03.699694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:03.703658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:03.704170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] PATH_INFO: `/v3/projects/2ba1d400574743c9ae3c2b4619e2d4f8` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:03.706291 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ba1d400574743c9ae3c2b4619e2d4f8)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:03.713497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:03.731098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108182b-321b-47cc-aabf-af4a09b0eb43 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:03.739644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f03db5-8723-4566-9b33-ab16d20f5afc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:03.740658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03db5-8723-4566-9b33-ab16d20f5afc service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:03.740991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03db5-8723-4566-9b33-ab16d20f5afc service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:03.741379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03db5-8723-4566-9b33-ab16d20f5afc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:03.754770 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f03db5-8723-4566-9b33-ab16d20f5afc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:03.756759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f03db5-8723-4566-9b33-ab16d20f5afc service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:03.767955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1029/2023] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:03 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:03.781313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ba1d400574743c9ae3c2b4619e2d4f8', 'request_id': 'req-6b377a55-623b-44e5-99ed-2194f4defcde'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:03.787853 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ba1d400574743c9ae3c2b4619e2d4f8', 'request_id': 'req-6b377a55-623b-44e5-99ed-2194f4defcde'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:03.795081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ba1d400574743c9ae3c2b4619e2d4f8', 'request_id': 'req-6b377a55-623b-44e5-99ed-2194f4defcde'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:03.824424 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] The token cache is being invalidate because project 2ba1d400574743c9ae3c2b4619e2d4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:03.824731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:03.825908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6b377a55-623b-44e5-99ed-2194f4defcde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:03.828526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 995/2024] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:03 2021] DELETE /identity/v3/projects/2ba1d400574743c9ae3c2b4619e2d4f8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:03.834274 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b7492-369e-4656-93ba-1be7dfbdcb19 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:03.834580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b7492-369e-4656-93ba-1be7dfbdcb19 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:03.835400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b7492-369e-4656-93ba-1be7dfbdcb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:03.855880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-190b7492-369e-4656-93ba-1be7dfbdcb19 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:03.857112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-190b7492-369e-4656-93ba-1be7dfbdcb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:03.926855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1030/2025] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:03.928911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f5be2-d4ec-4bc2-a976-a2d3121c1161 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:03.929331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f5be2-d4ec-4bc2-a976-a2d3121c1161 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:03.930333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f5be2-d4ec-4bc2-a976-a2d3121c1161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:03.957779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-163f5be2-d4ec-4bc2-a976-a2d3121c1161 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:03.959429 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-163f5be2-d4ec-4bc2-a976-a2d3121c1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:03.978366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 996/2026] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:03.979617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b7492-369e-4656-93ba-1be7dfbdcb19 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:03.994873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b7492-369e-4656-93ba-1be7dfbdcb19 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:03.999712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3303add-6418-4651-9c10-2f04bcc4e438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.000660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3303add-6418-4651-9c10-2f04bcc4e438 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.000961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3303add-6418-4651-9c10-2f04bcc4e438 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.001286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3303add-6418-4651-9c10-2f04bcc4e438 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.002151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3303add-6418-4651-9c10-2f04bcc4e438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:04.002466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3303add-6418-4651-9c10-2f04bcc4e438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.004630 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3303add-6418-4651-9c10-2f04bcc4e438 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.017591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1031/2027] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:28:04.022783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f5be2-d4ec-4bc2-a976-a2d3121c1161 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.036646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f5be2-d4ec-4bc2-a976-a2d3121c1161 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:04.043161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b571bb4-16a3-4db0-ae42-e23d19fc426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.044052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b571bb4-16a3-4db0-ae42-e23d19fc426f admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.044612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b571bb4-16a3-4db0-ae42-e23d19fc426f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.045149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b571bb4-16a3-4db0-ae42-e23d19fc426f admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.046195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b571bb4-16a3-4db0-ae42-e23d19fc426f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.048818 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b571bb4-16a3-4db0-ae42-e23d19fc426f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.087254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 997/2028] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:04 2021] POST /identity/v3/projects => generated 407 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:04.091628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3303add-6418-4651-9c10-2f04bcc4e438 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.116364 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3303add-6418-4651-9c10-2f04bcc4e438 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:04.215982 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d5b8f-6757-4c3b-bad4-4a3395df3ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.216681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d5b8f-6757-4c3b-bad4-4a3395df3ecd admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.217370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d5b8f-6757-4c3b-bad4-4a3395df3ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.217370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d5b8f-6757-4c3b-bad4-4a3395df3ecd admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.220040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d5b8f-6757-4c3b-bad4-4a3395df3ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.227725 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d5b8f-6757-4c3b-bad4-4a3395df3ecd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.259758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1032/2029] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:04 2021] POST /identity/v3/users => generated 304 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:04.261049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b571bb4-16a3-4db0-ae42-e23d19fc426f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.278213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b571bb4-16a3-4db0-ae42-e23d19fc426f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:04.282978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d07c-6e26-4541-9ca9-8222d7947209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.283636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d07c-6e26-4541-9ca9-8222d7947209 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.283920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d07c-6e26-4541-9ca9-8222d7947209 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.284197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d07c-6e26-4541-9ca9-8222d7947209 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.285603 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d07c-6e26-4541-9ca9-8222d7947209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.287203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d07c-6e26-4541-9ca9-8222d7947209 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.297388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 998/2030] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:04 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:04.301469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d5b8f-6757-4c3b-bad4-4a3395df3ecd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.311520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d5b8f-6757-4c3b-bad4-4a3395df3ecd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:04.316145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e5980-470b-4cca-b24e-ebf9f3226037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.316797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e5980-470b-4cca-b24e-ebf9f3226037 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.317077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e5980-470b-4cca-b24e-ebf9f3226037 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.317351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e5980-470b-4cca-b24e-ebf9f3226037 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.318101 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e5980-470b-4cca-b24e-ebf9f3226037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.319953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e5980-470b-4cca-b24e-ebf9f3226037 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.334787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1033/2031] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:04 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:04.339108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d07c-6e26-4541-9ca9-8222d7947209 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.349442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d07c-6e26-4541-9ca9-8222d7947209 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:04.354057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa584b-1728-4bb8-993c-7c33e478814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.354961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa584b-1728-4bb8-993c-7c33e478814b admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.355247 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa584b-1728-4bb8-993c-7c33e478814b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.355552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa584b-1728-4bb8-993c-7c33e478814b admin admin] PATH_INFO: `/v3/projects/36aa782d8eaa45fea12bb81ba60936aa/users/1f36aa7d020945b1a30d3f5e925f16ab/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.369767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa584b-1728-4bb8-993c-7c33e478814b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36aa782d8eaa45fea12bb81ba60936aa, user_id=1f36aa7d020945b1a30d3f5e925f16ab, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.372527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa584b-1728-4bb8-993c-7c33e478814b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.390054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 999/2032] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:04 2021] PUT /identity/v3/projects/36aa782d8eaa45fea12bb81ba60936aa/users/1f36aa7d020945b1a30d3f5e925f16ab/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:04.403686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51ae83-e09f-479c-9c3f-4455e8819775 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.403977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51ae83-e09f-479c-9c3f-4455e8819775 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.404258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51ae83-e09f-479c-9c3f-4455e8819775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.443935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6a51ae83-e09f-479c-9c3f-4455e8819775 None None] MFA Rules not processed for user `1f36aa7d020945b1a30d3f5e925f16ab`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:04.445314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6a51ae83-e09f-479c-9c3f-4455e8819775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:04.476292 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4c96f-b9ad-4d9b-ab1b-1310e1beee34 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.476590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4c96f-b9ad-4d9b-ab1b-1310e1beee34 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.476871 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4c96f-b9ad-4d9b-ab1b-1310e1beee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.494070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-5bb4c96f-b9ad-4d9b-ab1b-1310e1beee34 None None] MFA Rules not processed for user `f3f46b66092d4bc8956f979530a04ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:04.495329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5bb4c96f-b9ad-4d9b-ab1b-1310e1beee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:04.548034 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1034/2033] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:04 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:04.548963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51ae83-e09f-479c-9c3f-4455e8819775 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.563621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1000/2034] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:04 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:04.631630 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51ae83-e09f-479c-9c3f-4455e8819775 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:04.638257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9ad19-150a-48bd-90ac-8202a90454ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.639243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9ad19-150a-48bd-90ac-8202a90454ee admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.639528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9ad19-150a-48bd-90ac-8202a90454ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.639805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9ad19-150a-48bd-90ac-8202a90454ee admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.640492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9ad19-150a-48bd-90ac-8202a90454ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.642387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9ad19-150a-48bd-90ac-8202a90454ee admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.677119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1035/2035] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:04 2021] POST /identity/v3/projects => generated 409 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:04.678332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4c96f-b9ad-4d9b-ab1b-1310e1beee34 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.680265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9ad19-150a-48bd-90ac-8202a90454ee admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.683299 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8ea9ad19-150a-48bd-90ac-8202a90454ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:04.696910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4c96f-b9ad-4d9b-ab1b-1310e1beee34 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:04.757052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9ad19-150a-48bd-90ac-8202a90454ee admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:04.764354 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.765346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.765759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.766198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] PATH_INFO: `/v3/users/b6a7a36dc2bf4e068317f602ff19c115` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.767656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a7a36dc2bf4e068317f602ff19c115)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.770486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.771995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59730a4-2667-4ab4-884a-a9ca43d3218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.772667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59730a4-2667-4ab4-884a-a9ca43d3218f admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.772955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59730a4-2667-4ab4-884a-a9ca43d3218f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.773235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59730a4-2667-4ab4-884a-a9ca43d3218f admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.773927 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59730a4-2667-4ab4-884a-a9ca43d3218f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.775865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59730a4-2667-4ab4-884a-a9ca43d3218f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.799633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1001/2036] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:04 2021] POST /identity/v3/users => generated 311 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:04.803414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59730a4-2667-4ab4-884a-a9ca43d3218f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.817456 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59730a4-2667-4ab4-884a-a9ca43d3218f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:04.823324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d52e-cf3c-4bb6-ae42-f3a84ccf6e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.824149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d52e-cf3c-4bb6-ae42-f3a84ccf6e73 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.824576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d52e-cf3c-4bb6-ae42-f3a84ccf6e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.825116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d52e-cf3c-4bb6-ae42-f3a84ccf6e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.826156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425d52e-cf3c-4bb6-ae42-f3a84ccf6e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.828227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425d52e-cf3c-4bb6-ae42-f3a84ccf6e73 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.836409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a7a36dc2bf4e068317f602ff19c115'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:04.842715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1002/2037] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:04 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:04.847001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d52e-cf3c-4bb6-ae42-f3a84ccf6e73 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.856495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a7a36dc2bf4e068317f602ff19c115'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:04.857289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a7a36dc2bf4e068317f602ff19c115'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:04.861383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d52e-cf3c-4bb6-ae42-f3a84ccf6e73 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:04.865310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a7a36dc2bf4e068317f602ff19c115'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:04.866171 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a7a36dc2bf4e068317f602ff19c115'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:04.867285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173faea-c97d-42a5-991a-c989a6a3d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:04.868329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173faea-c97d-42a5-991a-c989a6a3d54d admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:04.868618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173faea-c97d-42a5-991a-c989a6a3d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:04.868899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173faea-c97d-42a5-991a-c989a6a3d54d admin admin] PATH_INFO: `/v3/projects/a9ea4cc121cd44ce99d6d858160369f5/users/9d4ac223916e4176a5ec27f55d6a1360/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:04.884548 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1036/2038] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:04 2021] DELETE /identity/v3/users/b6a7a36dc2bf4e068317f602ff19c115 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:04.900623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173faea-c97d-42a5-991a-c989a6a3d54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ea4cc121cd44ce99d6d858160369f5, user_id=9d4ac223916e4176a5ec27f55d6a1360, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:04.907782 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173faea-c97d-42a5-991a-c989a6a3d54d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:04.926176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1003/2039] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:04 2021] PUT /identity/v3/projects/a9ea4cc121cd44ce99d6d858160369f5/users/9d4ac223916e4176a5ec27f55d6a1360/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:04.930090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:04.931634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:05.015362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31791b6-a41f-45a9-b9a7-59a36752b6a9 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:05.091015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d154d-9777-4dd9-9be0-d26b5c7ca2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:05.091767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d154d-9777-4dd9-9be0-d26b5c7ca2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:05.092333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d154d-9777-4dd9-9be0-d26b5c7ca2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:05.092333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d154d-9777-4dd9-9be0-d26b5c7ca2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:05.093273 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d154d-9777-4dd9-9be0-d26b5c7ca2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:05.095226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d154d-9777-4dd9-9be0-d26b5c7ca2d6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:05.097536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173faea-c97d-42a5-991a-c989a6a3d54d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:05.100837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e173faea-c97d-42a5-991a-c989a6a3d54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:05.106022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1037/2040] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:04 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:05.110118 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d154d-9777-4dd9-9be0-d26b5c7ca2d6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:05.117756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173faea-c97d-42a5-991a-c989a6a3d54d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:05.123301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d154d-9777-4dd9-9be0-d26b5c7ca2d6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:05.126050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:05.126929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:05.127205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:05.127476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] PATH_INFO: `/v3/projects/bfe325632533412f8b9fc296d4d69812` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:05.130127 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe325632533412f8b9fc296d4d69812)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:05.132513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:05.137921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd492ff-0937-4407-b2dd-d2ddbd8d6893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:05.141592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd492ff-0937-4407-b2dd-d2ddbd8d6893 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:05.141592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd492ff-0937-4407-b2dd-d2ddbd8d6893 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:05.143099 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd492ff-0937-4407-b2dd-d2ddbd8d6893 admin admin] PATH_INFO: `/v3/projects/a9ea4cc121cd44ce99d6d858160369f5/users/9d4ac223916e4176a5ec27f55d6a1360/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:05.146250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd492ff-0937-4407-b2dd-d2ddbd8d6893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ea4cc121cd44ce99d6d858160369f5, user_id=9d4ac223916e4176a5ec27f55d6a1360, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:05.149031 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd492ff-0937-4407-b2dd-d2ddbd8d6893 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:05.168579 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1038/2041] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:05 2021] PUT /identity/v3/projects/a9ea4cc121cd44ce99d6d858160369f5/users/9d4ac223916e4176a5ec27f55d6a1360/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:05.170589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314e888-41c5-41d7-865c-f90e0b991c95 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:05.170904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314e888-41c5-41d7-865c-f90e0b991c95 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:05.171176 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314e888-41c5-41d7-865c-f90e0b991c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:05.202008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e314e888-41c5-41d7-865c-f90e0b991c95 None None] MFA Rules not processed for user `9d4ac223916e4176a5ec27f55d6a1360`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:05.203258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e314e888-41c5-41d7-865c-f90e0b991c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:05.203634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe325632533412f8b9fc296d4d69812', 'request_id': 'req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.210000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe325632533412f8b9fc296d4d69812', 'request_id': 'req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.215324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe325632533412f8b9fc296d4d69812', 'request_id': 'req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.241542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] The token cache is being invalidate because project bfe325632533412f8b9fc296d4d69812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:05.241841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.242515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.244111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1004/2042] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:05 2021] DELETE /identity/v3/projects/bfe325632533412f8b9fc296d4d69812 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:05.247805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:05.249135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:05.295821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1039/2043] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:05 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:05.306380 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314e888-41c5-41d7-865c-f90e0b991c95 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:05.307939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e314e888-41c5-41d7-865c-f90e0b991c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:05.333216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b5d1-d6ae-4dd4-a958-3b88ef580b98 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:05.339748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:05.340726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:05.341012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:05.341287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] PATH_INFO: `/v3/users/1272fcc049dd49b584baa7df13b3129a` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:05.343098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1272fcc049dd49b584baa7df13b3129a)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:05.345926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:05.387752 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314e888-41c5-41d7-865c-f90e0b991c95 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:05.393375 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0d22b-2b15-4c1d-b0c5-c6a8e2b4117b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:05.394251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0d22b-2b15-4c1d-b0c5-c6a8e2b4117b service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:05.394814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0d22b-2b15-4c1d-b0c5-c6a8e2b4117b service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:05.395978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0d22b-2b15-4c1d-b0c5-c6a8e2b4117b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:05.415300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0d22b-2b15-4c1d-b0c5-c6a8e2b4117b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:05.418927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0d22b-2b15-4c1d-b0c5-c6a8e2b4117b service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:05.427287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1272fcc049dd49b584baa7df13b3129a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.435464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1272fcc049dd49b584baa7df13b3129a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.436311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1272fcc049dd49b584baa7df13b3129a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.436943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1272fcc049dd49b584baa7df13b3129a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.453223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1272fcc049dd49b584baa7df13b3129a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.468651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1040/2044] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:05 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:28:05.511233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1005/2045] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:05 2021] DELETE /identity/v3/users/1272fcc049dd49b584baa7df13b3129a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:05.732748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0d22b-2b15-4c1d-b0c5-c6a8e2b4117b service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:05.737444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:05.739091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:05.750795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0d22b-2b15-4c1d-b0c5-c6a8e2b4117b service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:05.826158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:05.826657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9879e-9050-45e1-ba36-a70b059b813b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:05.827082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:05.827366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:05.827686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] PATH_INFO: `/v3/projects/87aac383d1fa44459afbfc92264d72f3` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:05.828867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87aac383d1fa44459afbfc92264d72f3)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:05.830833 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:05.831832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed6f97-d56d-47ae-ad94-9a0abc0d2c6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:05.832490 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed6f97-d56d-47ae-ad94-9a0abc0d2c6a service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:05.832782 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed6f97-d56d-47ae-ad94-9a0abc0d2c6a service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:05.833063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed6f97-d56d-47ae-ad94-9a0abc0d2c6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:05.835229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b8ed6f97-d56d-47ae-ad94-9a0abc0d2c6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:05.892135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87aac383d1fa44459afbfc92264d72f3', 'request_id': 'req-84dae05c-8bba-4f52-949b-b4434f16534b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.898665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed6f97-d56d-47ae-ad94-9a0abc0d2c6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:05.900171 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed6f97-d56d-47ae-ad94-9a0abc0d2c6a service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:05.901385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87aac383d1fa44459afbfc92264d72f3', 'request_id': 'req-84dae05c-8bba-4f52-949b-b4434f16534b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.908917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87aac383d1fa44459afbfc92264d72f3', 'request_id': 'req-84dae05c-8bba-4f52-949b-b4434f16534b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.916428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1006/2046] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:05 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:28:05.925983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] The token cache is being invalidate because project 87aac383d1fa44459afbfc92264d72f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:05.926430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.927103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-84dae05c-8bba-4f52-949b-b4434f16534b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:05.928821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1041/2047] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:05 2021] DELETE /identity/v3/projects/87aac383d1fa44459afbfc92264d72f3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:05.935088 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90846ac-8338-40b8-88fd-9e5fa581f0ac None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:05.935383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90846ac-8338-40b8-88fd-9e5fa581f0ac None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:05.935663 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90846ac-8338-40b8-88fd-9e5fa581f0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:05.953989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a90846ac-8338-40b8-88fd-9e5fa581f0ac None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:05.955359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a90846ac-8338-40b8-88fd-9e5fa581f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:06.047810 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1007/2048] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:06.057238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a6edd-4dbf-4520-84e3-1136bbea09b3 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:06.057524 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a6edd-4dbf-4520-84e3-1136bbea09b3 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:06.058411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a6edd-4dbf-4520-84e3-1136bbea09b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:06.085540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-542a6edd-4dbf-4520-84e3-1136bbea09b3 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:06.087440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-542a6edd-4dbf-4520-84e3-1136bbea09b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:06.099952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1042/2049] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:06.105070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90846ac-8338-40b8-88fd-9e5fa581f0ac None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:06.120270 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90846ac-8338-40b8-88fd-9e5fa581f0ac None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:06.133989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78508-c1b8-4c24-a087-817508bfbaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:06.134987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78508-c1b8-4c24-a087-817508bfbaac admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:06.135218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78508-c1b8-4c24-a087-817508bfbaac admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:06.135600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78508-c1b8-4c24-a087-817508bfbaac admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:06.137049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf78508-c1b8-4c24-a087-817508bfbaac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:06.137491 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf78508-c1b8-4c24-a087-817508bfbaac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:06.139450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf78508-c1b8-4c24-a087-817508bfbaac admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:06.154737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1008/2050] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:28:06.157056 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a6edd-4dbf-4520-84e3-1136bbea09b3 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:06.168242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a6edd-4dbf-4520-84e3-1136bbea09b3 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:06.174336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bda00e-d195-40be-908b-610630ff769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:06.175554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bda00e-d195-40be-908b-610630ff769b admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:06.176011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bda00e-d195-40be-908b-610630ff769b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:06.176470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bda00e-d195-40be-908b-610630ff769b admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:06.177311 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bda00e-d195-40be-908b-610630ff769b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:06.179400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bda00e-d195-40be-908b-610630ff769b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:06.217745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1043/2051] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:06 2021] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:06.222130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78508-c1b8-4c24-a087-817508bfbaac admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:06.237292 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78508-c1b8-4c24-a087-817508bfbaac admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:06.339786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91bf02-3c86-4fc3-87cd-f0184a7f4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:06.340463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91bf02-3c86-4fc3-87cd-f0184a7f4e91 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:06.340748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91bf02-3c86-4fc3-87cd-f0184a7f4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:06.341054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91bf02-3c86-4fc3-87cd-f0184a7f4e91 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:06.341764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91bf02-3c86-4fc3-87cd-f0184a7f4e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:06.343700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91bf02-3c86-4fc3-87cd-f0184a7f4e91 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:06.363520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1009/2052] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:06 2021] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:06.368416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bda00e-d195-40be-908b-610630ff769b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:06.379489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bda00e-d195-40be-908b-610630ff769b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:06.384305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed000f-41fa-4816-b9ee-913499e7c26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:06.385236 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed000f-41fa-4816-b9ee-913499e7c26f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:06.385518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed000f-41fa-4816-b9ee-913499e7c26f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:06.385793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed000f-41fa-4816-b9ee-913499e7c26f admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:06.386508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed000f-41fa-4816-b9ee-913499e7c26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:06.388119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed000f-41fa-4816-b9ee-913499e7c26f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:06.399094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1044/2053] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:06.403208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91bf02-3c86-4fc3-87cd-f0184a7f4e91 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:06.414165 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91bf02-3c86-4fc3-87cd-f0184a7f4e91 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:06.419838 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b717b-f8e9-48fa-9421-1acff56bfea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:06.420712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b717b-f8e9-48fa-9421-1acff56bfea9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:06.421007 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b717b-f8e9-48fa-9421-1acff56bfea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:06.421288 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b717b-f8e9-48fa-9421-1acff56bfea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:06.422257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b717b-f8e9-48fa-9421-1acff56bfea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:06.423874 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b717b-f8e9-48fa-9421-1acff56bfea9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:06.438117 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1010/2054] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:06 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:06.439803 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed000f-41fa-4816-b9ee-913499e7c26f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:06.453746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed000f-41fa-4816-b9ee-913499e7c26f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:06.464251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16a28-f254-4579-97b7-0ca84c0fb020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:06.465234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16a28-f254-4579-97b7-0ca84c0fb020 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:06.465559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16a28-f254-4579-97b7-0ca84c0fb020 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:06.465843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16a28-f254-4579-97b7-0ca84c0fb020 admin admin] PATH_INFO: `/v3/projects/ee3d44ad29e149f88a76713b8909e34f/users/2ae0024c482d48f48711c04d8a6693dc/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:06.481669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec16a28-f254-4579-97b7-0ca84c0fb020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3d44ad29e149f88a76713b8909e34f, user_id=2ae0024c482d48f48711c04d8a6693dc, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:06.484379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec16a28-f254-4579-97b7-0ca84c0fb020 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:06.499127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1045/2055] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:06 2021] PUT /identity/v3/projects/ee3d44ad29e149f88a76713b8909e34f/users/2ae0024c482d48f48711c04d8a6693dc/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:06.510623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db683b-0521-4ced-bd11-74b19167f736 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:06.510944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db683b-0521-4ced-bd11-74b19167f736 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:06.511219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db683b-0521-4ced-bd11-74b19167f736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:06.552461 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d1db683b-0521-4ced-bd11-74b19167f736 None None] MFA Rules not processed for user `2ae0024c482d48f48711c04d8a6693dc`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:06.553792 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d1db683b-0521-4ced-bd11-74b19167f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:06.683917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1011/2056] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:06 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:06.693280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16a28-f254-4579-97b7-0ca84c0fb020 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:06.695322 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3ec16a28-f254-4579-97b7-0ca84c0fb020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:06.798642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16a28-f254-4579-97b7-0ca84c0fb020 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:06.803354 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36b0bf-5dca-4f6f-9e6d-15b8f9e84579 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b9d35e26e64c959e075622321df3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:06.804080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36b0bf-5dca-4f6f-9e6d-15b8f9e84579 service glance] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:06.804373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36b0bf-5dca-4f6f-9e6d-15b8f9e84579 service glance] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:06.804651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36b0bf-5dca-4f6f-9e6d-15b8f9e84579 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:06.811753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db683b-0521-4ced-bd11-74b19167f736 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:06.813177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d1db683b-0521-4ced-bd11-74b19167f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:06.819463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36b0bf-5dca-4f6f-9e6d-15b8f9e84579 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:06.820943 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36b0bf-5dca-4f6f-9e6d-15b8f9e84579 service glance] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:06.830957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1046/2057] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:06 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:06.906210 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db683b-0521-4ced-bd11-74b19167f736 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:06.912487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:06.913738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:06.914124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:06.914474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] PATH_INFO: `/v3/users/5c9348a2a031476cab3d1280337b46ad` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:06.915825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9348a2a031476cab3d1280337b46ad)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:06.919975 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:06.979680 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9348a2a031476cab3d1280337b46ad'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:06.986986 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9348a2a031476cab3d1280337b46ad'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:06.988631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9348a2a031476cab3d1280337b46ad'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:06.989458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9348a2a031476cab3d1280337b46ad'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:06.997100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9348a2a031476cab3d1280337b46ad'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:07.019913 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1012/2058] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:06 2021] DELETE /identity/v3/users/5c9348a2a031476cab3d1280337b46ad => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:07.021878 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451afa8-f7a8-451e-8c74-7769ef923a9e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:07.022240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451afa8-f7a8-451e-8c74-7769ef923a9e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:07.022591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451afa8-f7a8-451e-8c74-7769ef923a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:07.041456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a451afa8-f7a8-451e-8c74-7769ef923a9e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:07.042662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a451afa8-f7a8-451e-8c74-7769ef923a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:07.107692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1047/2059] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:07.122624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:07.124381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:07.186956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797061-3ed4-43c2-9228-2c457fac5155 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:07.191430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa766b-90f0-47a3-8cf7-ab69e24fcb52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:07.192496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa766b-90f0-47a3-8cf7-ab69e24fcb52 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:07.192496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa766b-90f0-47a3-8cf7-ab69e24fcb52 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:07.192689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa766b-90f0-47a3-8cf7-ab69e24fcb52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:07.202313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa766b-90f0-47a3-8cf7-ab69e24fcb52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:07.203901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa766b-90f0-47a3-8cf7-ab69e24fcb52 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:07.214249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1013/2060] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:07.986089 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451afa8-f7a8-451e-8c74-7769ef923a9e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:07.987718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a451afa8-f7a8-451e-8c74-7769ef923a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:08.001902 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451afa8-f7a8-451e-8c74-7769ef923a9e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.008775 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.010239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.011119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.012163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] PATH_INFO: `/v3/projects/19c2b8ed86ab4cb79053fbce2835a2e0` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.013656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c2b8ed86ab4cb79053fbce2835a2e0)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.016826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.072454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c2b8ed86ab4cb79053fbce2835a2e0', 'request_id': 'req-b52f7276-c054-4c32-891c-4914f38d25ae'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:08.078607 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c2b8ed86ab4cb79053fbce2835a2e0', 'request_id': 'req-b52f7276-c054-4c32-891c-4914f38d25ae'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:08.084503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c2b8ed86ab4cb79053fbce2835a2e0', 'request_id': 'req-b52f7276-c054-4c32-891c-4914f38d25ae'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:08.096828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] The token cache is being invalidate because project 19c2b8ed86ab4cb79053fbce2835a2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:08.097734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:08.098514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b52f7276-c054-4c32-891c-4914f38d25ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:08.100213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1048/2061] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:07 2021] DELETE /identity/v3/projects/19c2b8ed86ab4cb79053fbce2835a2e0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:08.106100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24224a-8b3a-48ff-a228-beca825bcb11 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.106645 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24224a-8b3a-48ff-a228-beca825bcb11 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.107139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24224a-8b3a-48ff-a228-beca825bcb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.125750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-fc24224a-8b3a-48ff-a228-beca825bcb11 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:08.127034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-fc24224a-8b3a-48ff-a228-beca825bcb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:08.202381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1014/2062] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:08.210348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400df4-e0bd-4536-8f1a-86f0a00a78ca None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.210892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400df4-e0bd-4536-8f1a-86f0a00a78ca None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.211023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400df4-e0bd-4536-8f1a-86f0a00a78ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.229321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-30400df4-e0bd-4536-8f1a-86f0a00a78ca None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:08.230511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-30400df4-e0bd-4536-8f1a-86f0a00a78ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:08.239045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1049/2063] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:08.243157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24224a-8b3a-48ff-a228-beca825bcb11 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.253322 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24224a-8b3a-48ff-a228-beca825bcb11 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.257913 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140734f-8ab1-4395-91d9-3e87563b07b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.258599 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140734f-8ab1-4395-91d9-3e87563b07b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.258922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140734f-8ab1-4395-91d9-3e87563b07b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.259246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140734f-8ab1-4395-91d9-3e87563b07b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.259966 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140734f-8ab1-4395-91d9-3e87563b07b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:08.260270 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140734f-8ab1-4395-91d9-3e87563b07b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.261854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140734f-8ab1-4395-91d9-3e87563b07b0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.274120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1015/2064] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:28:08.278383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30400df4-e0bd-4536-8f1a-86f0a00a78ca None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.288054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30400df4-e0bd-4536-8f1a-86f0a00a78ca None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.292606 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74709ba-a39e-4005-9d09-97bf14f4e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.293248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74709ba-a39e-4005-9d09-97bf14f4e85f admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.293531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74709ba-a39e-4005-9d09-97bf14f4e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.293805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74709ba-a39e-4005-9d09-97bf14f4e85f admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.294509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74709ba-a39e-4005-9d09-97bf14f4e85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.296421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74709ba-a39e-4005-9d09-97bf14f4e85f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.321011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1050/2065] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:08 2021] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:08.324965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140734f-8ab1-4395-91d9-3e87563b07b0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.335114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140734f-8ab1-4395-91d9-3e87563b07b0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.397076 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1efb6-f9ce-4b5e-9159-aa1b19af08aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.398145 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1efb6-f9ce-4b5e-9159-aa1b19af08aa admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.398590 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1efb6-f9ce-4b5e-9159-aa1b19af08aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.398909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1efb6-f9ce-4b5e-9159-aa1b19af08aa admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.399606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1efb6-f9ce-4b5e-9159-aa1b19af08aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.401505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1efb6-f9ce-4b5e-9159-aa1b19af08aa admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.429198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1016/2066] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:08 2021] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:08.430038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74709ba-a39e-4005-9d09-97bf14f4e85f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.440300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74709ba-a39e-4005-9d09-97bf14f4e85f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.445400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed761e35-1c76-4075-b7f0-698d40eac4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.446055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed761e35-1c76-4075-b7f0-698d40eac4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.446338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed761e35-1c76-4075-b7f0-698d40eac4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.446611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed761e35-1c76-4075-b7f0-698d40eac4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.447362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed761e35-1c76-4075-b7f0-698d40eac4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.448983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed761e35-1c76-4075-b7f0-698d40eac4c1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.459542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1051/2067] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:08.463931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1efb6-f9ce-4b5e-9159-aa1b19af08aa admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.473539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1efb6-f9ce-4b5e-9159-aa1b19af08aa admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.478369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba8f16-38e8-46a9-b4f9-f981d4b87c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.479060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba8f16-38e8-46a9-b4f9-f981d4b87c74 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.479379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba8f16-38e8-46a9-b4f9-f981d4b87c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.479627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba8f16-38e8-46a9-b4f9-f981d4b87c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.480337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba8f16-38e8-46a9-b4f9-f981d4b87c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.481905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba8f16-38e8-46a9-b4f9-f981d4b87c74 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.492002 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1017/2068] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:08 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:08.496232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed761e35-1c76-4075-b7f0-698d40eac4c1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.506539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed761e35-1c76-4075-b7f0-698d40eac4c1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.511581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d989-539d-45f4-b5cc-7bc1d72f190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.512019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d989-539d-45f4-b5cc-7bc1d72f190d admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.512297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d989-539d-45f4-b5cc-7bc1d72f190d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.512567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d989-539d-45f4-b5cc-7bc1d72f190d admin admin] PATH_INFO: `/v3/projects/20945d1a65fd46f098f2c1793106c54a/users/c2ddd38b950b460bbdfda8cd518ebdcd/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.527498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7d989-539d-45f4-b5cc-7bc1d72f190d admin admin] RBAC: Authorizing `identity:create_grant(project_id=20945d1a65fd46f098f2c1793106c54a, user_id=c2ddd38b950b460bbdfda8cd518ebdcd, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.530188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7d989-539d-45f4-b5cc-7bc1d72f190d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.542250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1052/2069] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:08 2021] PUT /identity/v3/projects/20945d1a65fd46f098f2c1793106c54a/users/c2ddd38b950b460bbdfda8cd518ebdcd/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:08.552288 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21213c58-38b0-4bee-b6f0-1341032c9bc9 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.552577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21213c58-38b0-4bee-b6f0-1341032c9bc9 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.552854 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21213c58-38b0-4bee-b6f0-1341032c9bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.579228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-21213c58-38b0-4bee-b6f0-1341032c9bc9 None None] MFA Rules not processed for user `c2ddd38b950b460bbdfda8cd518ebdcd`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:08.580473 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-21213c58-38b0-4bee-b6f0-1341032c9bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:08.642832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1018/2070] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:08 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:08.648019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d989-539d-45f4-b5cc-7bc1d72f190d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.712979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d989-539d-45f4-b5cc-7bc1d72f190d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.717620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924d34c-1454-4b48-8de7-7f7ca87c6f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.718282 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924d34c-1454-4b48-8de7-7f7ca87c6f53 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.718570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924d34c-1454-4b48-8de7-7f7ca87c6f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.718880 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924d34c-1454-4b48-8de7-7f7ca87c6f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.719610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924d34c-1454-4b48-8de7-7f7ca87c6f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.721512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924d34c-1454-4b48-8de7-7f7ca87c6f53 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.747707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1053/2071] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:08 2021] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:08.752862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21213c58-38b0-4bee-b6f0-1341032c9bc9 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.765395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21213c58-38b0-4bee-b6f0-1341032c9bc9 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.824592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53bf2d-01b5-4234-a84c-734eca931805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.825345 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53bf2d-01b5-4234-a84c-734eca931805 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.825634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53bf2d-01b5-4234-a84c-734eca931805 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.825978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53bf2d-01b5-4234-a84c-734eca931805 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.826690 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53bf2d-01b5-4234-a84c-734eca931805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.828704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53bf2d-01b5-4234-a84c-734eca931805 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.847515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1019/2072] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:08 2021] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:08.851395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924d34c-1454-4b48-8de7-7f7ca87c6f53 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.861340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924d34c-1454-4b48-8de7-7f7ca87c6f53 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.866329 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0bc10-76ec-4285-9066-c6c767abf5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.867026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0bc10-76ec-4285-9066-c6c767abf5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.867311 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0bc10-76ec-4285-9066-c6c767abf5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.867588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0bc10-76ec-4285-9066-c6c767abf5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.868300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0bc10-76ec-4285-9066-c6c767abf5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.870124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0bc10-76ec-4285-9066-c6c767abf5c1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.880887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1054/2073] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:08.884759 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53bf2d-01b5-4234-a84c-734eca931805 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.894521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53bf2d-01b5-4234-a84c-734eca931805 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:08.899110 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08989a3e-c317-4ac8-b42f-e9caf4d093fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:08.899976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989a3e-c317-4ac8-b42f-e9caf4d093fd admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:08.900254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989a3e-c317-4ac8-b42f-e9caf4d093fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:08.900528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989a3e-c317-4ac8-b42f-e9caf4d093fd admin admin] PATH_INFO: `/v3/projects/395bafb9501e4ac396ebbd2706d64ccd/users/cfe29f9643be4aa8a064b44b486fa9ab/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:08.914497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08989a3e-c317-4ac8-b42f-e9caf4d093fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=395bafb9501e4ac396ebbd2706d64ccd, user_id=cfe29f9643be4aa8a064b44b486fa9ab, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:08.917250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08989a3e-c317-4ac8-b42f-e9caf4d093fd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:08.930928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1020/2074] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:08 2021] PUT /identity/v3/projects/395bafb9501e4ac396ebbd2706d64ccd/users/cfe29f9643be4aa8a064b44b486fa9ab/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:08.934908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0bc10-76ec-4285-9066-c6c767abf5c1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:08.945331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0bc10-76ec-4285-9066-c6c767abf5c1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:09.000906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb329e6-5d1d-443f-be9d-3e9182ada039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:09.001571 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb329e6-5d1d-443f-be9d-3e9182ada039 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:09.001848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb329e6-5d1d-443f-be9d-3e9182ada039 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:09.002118 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb329e6-5d1d-443f-be9d-3e9182ada039 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:09.002873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb329e6-5d1d-443f-be9d-3e9182ada039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:09.005057 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb329e6-5d1d-443f-be9d-3e9182ada039 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:09.016529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1055/2075] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:08 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:09.021048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08989a3e-c317-4ac8-b42f-e9caf4d093fd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:09.034035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08989a3e-c317-4ac8-b42f-e9caf4d093fd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:09.040233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330be8f7-050a-4fca-b29e-1b05af8fac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:09.041256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330be8f7-050a-4fca-b29e-1b05af8fac66 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:09.041443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330be8f7-050a-4fca-b29e-1b05af8fac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:09.041720 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330be8f7-050a-4fca-b29e-1b05af8fac66 admin admin] PATH_INFO: `/v3/projects/395bafb9501e4ac396ebbd2706d64ccd/users/cfe29f9643be4aa8a064b44b486fa9ab/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:09.043754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330be8f7-050a-4fca-b29e-1b05af8fac66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395bafb9501e4ac396ebbd2706d64ccd, user_id=cfe29f9643be4aa8a064b44b486fa9ab, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:09.046404 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330be8f7-050a-4fca-b29e-1b05af8fac66 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:09.057750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1021/2076] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:09 2021] PUT /identity/v3/projects/395bafb9501e4ac396ebbd2706d64ccd/users/cfe29f9643be4aa8a064b44b486fa9ab/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:09.069762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b38e2-e127-41c5-8df7-0e5e0f8afe35 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:09.070163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b38e2-e127-41c5-8df7-0e5e0f8afe35 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:09.070552 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b38e2-e127-41c5-8df7-0e5e0f8afe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:09.104659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-722b38e2-e127-41c5-8df7-0e5e0f8afe35 None None] MFA Rules not processed for user `cfe29f9643be4aa8a064b44b486fa9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:09.105948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-722b38e2-e127-41c5-8df7-0e5e0f8afe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:09.193780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1056/2077] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:09 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:09.205126 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330be8f7-050a-4fca-b29e-1b05af8fac66 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:09.206940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-330be8f7-050a-4fca-b29e-1b05af8fac66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:09.266279 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330be8f7-050a-4fca-b29e-1b05af8fac66 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:09.270245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331eb3cb-2a22-4f93-abe1-d6eb72437202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:09.271101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eb3cb-2a22-4f93-abe1-d6eb72437202 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:09.271384 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eb3cb-2a22-4f93-abe1-d6eb72437202 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:09.271664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eb3cb-2a22-4f93-abe1-d6eb72437202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:09.281995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331eb3cb-2a22-4f93-abe1-d6eb72437202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:09.283476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331eb3cb-2a22-4f93-abe1-d6eb72437202 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:09.293878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1022/2078] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:09 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:09.442701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b38e2-e127-41c5-8df7-0e5e0f8afe35 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:09.502750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b38e2-e127-41c5-8df7-0e5e0f8afe35 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:09.507280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:09.508155 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:09.508438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:09.508715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] PATH_INFO: `/v3/users/c2ddd38b950b460bbdfda8cd518ebdcd` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:09.509904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ddd38b950b460bbdfda8cd518ebdcd)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:09.511879 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:09.556110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ddd38b950b460bbdfda8cd518ebdcd'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:09.567415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ddd38b950b460bbdfda8cd518ebdcd'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:09.568106 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ddd38b950b460bbdfda8cd518ebdcd'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:09.577190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ddd38b950b460bbdfda8cd518ebdcd'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:09.579001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ddd38b950b460bbdfda8cd518ebdcd'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:09.600183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1057/2079] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:09 2021] DELETE /identity/v3/users/c2ddd38b950b460bbdfda8cd518ebdcd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:09.604871 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f405e5-f5b0-4f38-9c6a-af220114e523 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:09.605235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f405e5-f5b0-4f38-9c6a-af220114e523 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:09.605521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f405e5-f5b0-4f38-9c6a-af220114e523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:09.622577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-57f405e5-f5b0-4f38-9c6a-af220114e523 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:09.623795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-57f405e5-f5b0-4f38-9c6a-af220114e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:09.679104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1023/2080] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:09.689378 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:09.690973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:09.746598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c860326-1ee8-4040-acb0-e93cca8adac5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:09.750722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab873c2-20ee-4c80-817e-5a87426725ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:09.751380 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab873c2-20ee-4c80-817e-5a87426725ba service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:09.751664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab873c2-20ee-4c80-817e-5a87426725ba service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:09.751939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab873c2-20ee-4c80-817e-5a87426725ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:09.760888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab873c2-20ee-4c80-817e-5a87426725ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:09.762308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab873c2-20ee-4c80-817e-5a87426725ba service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:09.772211 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1058/2081] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:10.080138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f405e5-f5b0-4f38-9c6a-af220114e523 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:10.082451 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-57f405e5-f5b0-4f38-9c6a-af220114e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:10.097507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f405e5-f5b0-4f38-9c6a-af220114e523 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:10.102165 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:10.103326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:10.103623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:10.103900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] PATH_INFO: `/v3/projects/20945d1a65fd46f098f2c1793106c54a` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:10.105059 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20945d1a65fd46f098f2c1793106c54a)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:10.106991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:10.153815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20945d1a65fd46f098f2c1793106c54a', 'request_id': 'req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.159794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20945d1a65fd46f098f2c1793106c54a', 'request_id': 'req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.165005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20945d1a65fd46f098f2c1793106c54a', 'request_id': 'req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.178790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] The token cache is being invalidate because project 20945d1a65fd46f098f2c1793106c54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:10.179078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.179725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.181299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1024/2082] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:10 2021] DELETE /identity/v3/projects/20945d1a65fd46f098f2c1793106c54a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:10.185440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab873c2-20ee-4c80-817e-5a87426725ba service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:10.195592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab873c2-20ee-4c80-817e-5a87426725ba service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:10.249071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:10.249945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:10.250223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:10.251180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] PATH_INFO: `/v3/users/cfe29f9643be4aa8a064b44b486fa9ab` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:10.252429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe29f9643be4aa8a064b44b486fa9ab)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:10.254993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:10.302493 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe29f9643be4aa8a064b44b486fa9ab'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.314037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe29f9643be4aa8a064b44b486fa9ab'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.314762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe29f9643be4aa8a064b44b486fa9ab'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.324841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe29f9643be4aa8a064b44b486fa9ab'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.325732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2995f891-93c4-424c-9a95-71d9a582f14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe29f9643be4aa8a064b44b486fa9ab'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.342770 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1059/2083] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:10 2021] DELETE /identity/v3/users/cfe29f9643be4aa8a064b44b486fa9ab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:10.706092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:10.707591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:10.720947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb7e8c-0bb6-474b-ba6b-a3011dc225d7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:10.787492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:10.788375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:10.788654 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:10.788924 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] PATH_INFO: `/v3/projects/395bafb9501e4ac396ebbd2706d64ccd` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:10.790097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395bafb9501e4ac396ebbd2706d64ccd)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:10.792088 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:10.837770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395bafb9501e4ac396ebbd2706d64ccd', 'request_id': 'req-c4a84dc8-0327-4c09-80bc-84cd854f2741'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.843774 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395bafb9501e4ac396ebbd2706d64ccd', 'request_id': 'req-c4a84dc8-0327-4c09-80bc-84cd854f2741'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.849510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395bafb9501e4ac396ebbd2706d64ccd', 'request_id': 'req-c4a84dc8-0327-4c09-80bc-84cd854f2741'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.861494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] The token cache is being invalidate because project 395bafb9501e4ac396ebbd2706d64ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:10.861785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.863052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c4a84dc8-0327-4c09-80bc-84cd854f2741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:10.864573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1025/2084] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:10 2021] DELETE /identity/v3/projects/395bafb9501e4ac396ebbd2706d64ccd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:10.870380 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758a16a-f50b-4eae-ba31-efae945f36f5 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:10.870879 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758a16a-f50b-4eae-ba31-efae945f36f5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:10.870989 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758a16a-f50b-4eae-ba31-efae945f36f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:10.888676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-f758a16a-f50b-4eae-ba31-efae945f36f5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:10.890124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f758a16a-f50b-4eae-ba31-efae945f36f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:10.945644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1060/2085] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:10.953552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b59c2f-81bf-44f1-97dc-3a0285597c1d None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:10.953781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b59c2f-81bf-44f1-97dc-3a0285597c1d None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:10.954064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b59c2f-81bf-44f1-97dc-3a0285597c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:10.972769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d9b59c2f-81bf-44f1-97dc-3a0285597c1d None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:10.973955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d9b59c2f-81bf-44f1-97dc-3a0285597c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:10.981657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1026/2086] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:10.985660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758a16a-f50b-4eae-ba31-efae945f36f5 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:10.995135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758a16a-f50b-4eae-ba31-efae945f36f5 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:10.999694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d49fd-f2a6-48ca-a425-eb168f3a5280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.000337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d49fd-f2a6-48ca-a425-eb168f3a5280 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.000623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d49fd-f2a6-48ca-a425-eb168f3a5280 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.000897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d49fd-f2a6-48ca-a425-eb168f3a5280 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.001608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d49fd-f2a6-48ca-a425-eb168f3a5280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:11.001911 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d49fd-f2a6-48ca-a425-eb168f3a5280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.003543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d49fd-f2a6-48ca-a425-eb168f3a5280 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.016220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1061/2087] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:28:11.021038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b59c2f-81bf-44f1-97dc-3a0285597c1d None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.030961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b59c2f-81bf-44f1-97dc-3a0285597c1d None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.038739 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969ddb2-1047-4217-9924-1a10612aeea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.039624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969ddb2-1047-4217-9924-1a10612aeea8 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.040009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969ddb2-1047-4217-9924-1a10612aeea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.040355 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969ddb2-1047-4217-9924-1a10612aeea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.041245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969ddb2-1047-4217-9924-1a10612aeea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.043468 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969ddb2-1047-4217-9924-1a10612aeea8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.079910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1027/2088] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:11 2021] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:11.084594 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d49fd-f2a6-48ca-a425-eb168f3a5280 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.095259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d49fd-f2a6-48ca-a425-eb168f3a5280 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.163688 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bebb3f-6d7a-4ac7-9bc9-be40c92b1390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.164556 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebb3f-6d7a-4ac7-9bc9-be40c92b1390 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.164853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebb3f-6d7a-4ac7-9bc9-be40c92b1390 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.165140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebb3f-6d7a-4ac7-9bc9-be40c92b1390 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.166016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bebb3f-6d7a-4ac7-9bc9-be40c92b1390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.168045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bebb3f-6d7a-4ac7-9bc9-be40c92b1390 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.192288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1062/2089] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:11 2021] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:11.196208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969ddb2-1047-4217-9924-1a10612aeea8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.207359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969ddb2-1047-4217-9924-1a10612aeea8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.215544 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89efdc-1fca-4e9e-86a6-7d18e3884b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.216440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89efdc-1fca-4e9e-86a6-7d18e3884b9d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.216864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89efdc-1fca-4e9e-86a6-7d18e3884b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.217089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89efdc-1fca-4e9e-86a6-7d18e3884b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.217825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89efdc-1fca-4e9e-86a6-7d18e3884b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.219688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89efdc-1fca-4e9e-86a6-7d18e3884b9d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.232745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1028/2090] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:11 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:11.236886 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bebb3f-6d7a-4ac7-9bc9-be40c92b1390 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.247813 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bebb3f-6d7a-4ac7-9bc9-be40c92b1390 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.252646 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8220b93-4329-48de-bdc4-593b51fd07e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.253352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8220b93-4329-48de-bdc4-593b51fd07e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.253640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8220b93-4329-48de-bdc4-593b51fd07e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.253921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8220b93-4329-48de-bdc4-593b51fd07e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.254651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8220b93-4329-48de-bdc4-593b51fd07e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.256473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8220b93-4329-48de-bdc4-593b51fd07e4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.270790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1063/2091] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:11.272309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89efdc-1fca-4e9e-86a6-7d18e3884b9d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.283808 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89efdc-1fca-4e9e-86a6-7d18e3884b9d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.289055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b71ed-99dd-47e3-87e6-29ba315e3780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.289922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b71ed-99dd-47e3-87e6-29ba315e3780 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.290201 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b71ed-99dd-47e3-87e6-29ba315e3780 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.290476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b71ed-99dd-47e3-87e6-29ba315e3780 admin admin] PATH_INFO: `/v3/projects/454f7893a75a4d839673acd926961bbd/users/333fb92765d44d57a2318be0ee15eec3/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.304813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b71ed-99dd-47e3-87e6-29ba315e3780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454f7893a75a4d839673acd926961bbd, user_id=333fb92765d44d57a2318be0ee15eec3, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.307512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b71ed-99dd-47e3-87e6-29ba315e3780 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.333939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1029/2092] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:11 2021] PUT /identity/v3/projects/454f7893a75a4d839673acd926961bbd/users/333fb92765d44d57a2318be0ee15eec3/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:11.336202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0667b2-d2b9-47e2-ac2b-8219b4859511 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.336897 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0667b2-d2b9-47e2-ac2b-8219b4859511 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.337312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0667b2-d2b9-47e2-ac2b-8219b4859511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.366086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-6a0667b2-d2b9-47e2-ac2b-8219b4859511 None None] MFA Rules not processed for user `333fb92765d44d57a2318be0ee15eec3`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:11.367495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-6a0667b2-d2b9-47e2-ac2b-8219b4859511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:11.433152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1064/2093] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:11 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:11.437757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b71ed-99dd-47e3-87e6-29ba315e3780 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.501109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b71ed-99dd-47e3-87e6-29ba315e3780 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.507652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fed71-d309-4987-8b24-02224670cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.508311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fed71-d309-4987-8b24-02224670cd36 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.508596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fed71-d309-4987-8b24-02224670cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.508872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fed71-d309-4987-8b24-02224670cd36 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.509577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fed71-d309-4987-8b24-02224670cd36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.511512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fed71-d309-4987-8b24-02224670cd36 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.541608 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1030/2094] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:11 2021] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:11.543753 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0667b2-d2b9-47e2-ac2b-8219b4859511 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.557024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0667b2-d2b9-47e2-ac2b-8219b4859511 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.637686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6fb1-7308-43c3-96e4-846078c93873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.638382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6fb1-7308-43c3-96e4-846078c93873 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.638671 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6fb1-7308-43c3-96e4-846078c93873 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.639237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6fb1-7308-43c3-96e4-846078c93873 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.639948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a6fb1-7308-43c3-96e4-846078c93873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.641912 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a6fb1-7308-43c3-96e4-846078c93873 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.665770 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1065/2095] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:11 2021] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:11.670130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fed71-d309-4987-8b24-02224670cd36 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.682960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fed71-d309-4987-8b24-02224670cd36 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.688917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7367424-7862-4dcd-999a-a9a85dc41ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.689903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7367424-7862-4dcd-999a-a9a85dc41ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.690508 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7367424-7862-4dcd-999a-a9a85dc41ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.691490 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7367424-7862-4dcd-999a-a9a85dc41ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.692251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7367424-7862-4dcd-999a-a9a85dc41ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.693971 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7367424-7862-4dcd-999a-a9a85dc41ff0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.706281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1031/2096] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:11 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:11.710297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6fb1-7308-43c3-96e4-846078c93873 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.720754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6fb1-7308-43c3-96e4-846078c93873 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.725535 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aee501-2f95-4a59-b4c5-bdcb9ea897cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.726438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aee501-2f95-4a59-b4c5-bdcb9ea897cf admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.726755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aee501-2f95-4a59-b4c5-bdcb9ea897cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.727032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aee501-2f95-4a59-b4c5-bdcb9ea897cf admin admin] PATH_INFO: `/v3/projects/16e6bec2943a4305b68ae4edfde04c42/users/135dff618271406ebaf9c2dcc8e4adea/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.744146 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aee501-2f95-4a59-b4c5-bdcb9ea897cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e6bec2943a4305b68ae4edfde04c42, user_id=135dff618271406ebaf9c2dcc8e4adea, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.746428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aee501-2f95-4a59-b4c5-bdcb9ea897cf admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.769142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1066/2097] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:11 2021] PUT /identity/v3/projects/16e6bec2943a4305b68ae4edfde04c42/users/135dff618271406ebaf9c2dcc8e4adea/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:11.769977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7367424-7862-4dcd-999a-a9a85dc41ff0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.786647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7367424-7862-4dcd-999a-a9a85dc41ff0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.896520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a7534-cc1a-42ca-9fd2-aa11d7399df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.896520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a7534-cc1a-42ca-9fd2-aa11d7399df4 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.896520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a7534-cc1a-42ca-9fd2-aa11d7399df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.896520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a7534-cc1a-42ca-9fd2-aa11d7399df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.896908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a7534-cc1a-42ca-9fd2-aa11d7399df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.897961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a7534-cc1a-42ca-9fd2-aa11d7399df4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.908999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1032/2098] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:11 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:11.913079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aee501-2f95-4a59-b4c5-bdcb9ea897cf admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:11.923495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aee501-2f95-4a59-b4c5-bdcb9ea897cf admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:11.929365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8658-f2c0-4387-8404-771095a89026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:11.930514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8658-f2c0-4387-8404-771095a89026 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.930828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8658-f2c0-4387-8404-771095a89026 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.931105 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8658-f2c0-4387-8404-771095a89026 admin admin] PATH_INFO: `/v3/projects/16e6bec2943a4305b68ae4edfde04c42/users/135dff618271406ebaf9c2dcc8e4adea/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.934520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d8658-f2c0-4387-8404-771095a89026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e6bec2943a4305b68ae4edfde04c42, user_id=135dff618271406ebaf9c2dcc8e4adea, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:11.937184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d8658-f2c0-4387-8404-771095a89026 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:11.948887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1067/2099] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:11 2021] PUT /identity/v3/projects/16e6bec2943a4305b68ae4edfde04c42/users/135dff618271406ebaf9c2dcc8e4adea/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:11.959623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89872ad-8805-4821-805b-b3dc93fe10ad None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:11.959912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89872ad-8805-4821-805b-b3dc93fe10ad None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:11.960188 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89872ad-8805-4821-805b-b3dc93fe10ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:11.991735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-e89872ad-8805-4821-805b-b3dc93fe10ad None None] MFA Rules not processed for user `135dff618271406ebaf9c2dcc8e4adea`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:11.992756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e89872ad-8805-4821-805b-b3dc93fe10ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:12.063797 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1033/2100] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:11 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:12.074493 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8658-f2c0-4387-8404-771095a89026 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:12.076823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a25d8658-f2c0-4387-8404-771095a89026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:12.142101 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8658-f2c0-4387-8404-771095a89026 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:12.146196 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814811c-46dd-4300-833a-96a941e4d493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:12.146945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814811c-46dd-4300-833a-96a941e4d493 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:12.147292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814811c-46dd-4300-833a-96a941e4d493 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:12.147575 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814811c-46dd-4300-833a-96a941e4d493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:12.157901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814811c-46dd-4300-833a-96a941e4d493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:12.159955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814811c-46dd-4300-833a-96a941e4d493 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:12.175727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1068/2101] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:12 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:12.549433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89872ad-8805-4821-805b-b3dc93fe10ad None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:12.634161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89872ad-8805-4821-805b-b3dc93fe10ad None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:12.639398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:12.640440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:12.640779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:12.641116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] PATH_INFO: `/v3/users/333fb92765d44d57a2318be0ee15eec3` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:12.649744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333fb92765d44d57a2318be0ee15eec3)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:12.651834 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:12.696492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333fb92765d44d57a2318be0ee15eec3'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:12.702901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333fb92765d44d57a2318be0ee15eec3'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:12.703549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333fb92765d44d57a2318be0ee15eec3'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:12.704149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333fb92765d44d57a2318be0ee15eec3'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:12.711344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333fb92765d44d57a2318be0ee15eec3'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:12.728588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1034/2102] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:12 2021] DELETE /identity/v3/users/333fb92765d44d57a2318be0ee15eec3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:12.733058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f44a4-177c-4bd4-bd5c-5bce688cdc46 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:12.733348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f44a4-177c-4bd4-bd5c-5bce688cdc46 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:12.733628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f44a4-177c-4bd4-bd5c-5bce688cdc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:12.750659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-007f44a4-177c-4bd4-bd5c-5bce688cdc46 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:12.751815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-007f44a4-177c-4bd4-bd5c-5bce688cdc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:12.814173 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1069/2103] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:12.827309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:12.828749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:12.889496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93e096-16ee-44bb-b467-8c5cc4fb6669 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:12.893328 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb9d23-27f3-4212-9f6d-e8515236ce56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:12.895001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9d23-27f3-4212-9f6d-e8515236ce56 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:12.895001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9d23-27f3-4212-9f6d-e8515236ce56 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:12.895450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9d23-27f3-4212-9f6d-e8515236ce56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:12.904833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb9d23-27f3-4212-9f6d-e8515236ce56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:12.906262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb9d23-27f3-4212-9f6d-e8515236ce56 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:12.915652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1035/2104] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:28:13.279931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f44a4-177c-4bd4-bd5c-5bce688cdc46 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:13.281763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-007f44a4-177c-4bd4-bd5c-5bce688cdc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:13.296573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f44a4-177c-4bd4-bd5c-5bce688cdc46 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:13.303336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:13.304458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:13.304899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:13.305243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] PATH_INFO: `/v3/projects/454f7893a75a4d839673acd926961bbd` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:13.306639 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=454f7893a75a4d839673acd926961bbd)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:13.308896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:13.374590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454f7893a75a4d839673acd926961bbd', 'request_id': 'req-47b68ebb-d619-41a8-a02d-9aa43834ab99'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:13.381710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454f7893a75a4d839673acd926961bbd', 'request_id': 'req-47b68ebb-d619-41a8-a02d-9aa43834ab99'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:13.388255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454f7893a75a4d839673acd926961bbd', 'request_id': 'req-47b68ebb-d619-41a8-a02d-9aa43834ab99'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:13.401678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] The token cache is being invalidate because project 454f7893a75a4d839673acd926961bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:13.402069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:13.402907 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:13.404923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1070/2105] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:13 2021] DELETE /identity/v3/projects/454f7893a75a4d839673acd926961bbd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:13.408698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb9d23-27f3-4212-9f6d-e8515236ce56 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:13.418902 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb9d23-27f3-4212-9f6d-e8515236ce56 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:13.482449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:13.490263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:13.490669 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:13.491075 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] PATH_INFO: `/v3/users/135dff618271406ebaf9c2dcc8e4adea` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:13.493236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135dff618271406ebaf9c2dcc8e4adea)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:13.495483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:13.561623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135dff618271406ebaf9c2dcc8e4adea'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:13.569389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135dff618271406ebaf9c2dcc8e4adea'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:13.570023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135dff618271406ebaf9c2dcc8e4adea'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:13.570749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135dff618271406ebaf9c2dcc8e4adea'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:13.595316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d39d4377-025d-42f5-ae71-0ec5255ea005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135dff618271406ebaf9c2dcc8e4adea'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:13.630594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1036/2106] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:13 2021] DELETE /identity/v3/users/135dff618271406ebaf9c2dcc8e4adea => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:13.984924 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:13.986419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:13.999110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b68ebb-d619-41a8-a02d-9aa43834ab99 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:14.055551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:14.056485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.056772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.057049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] PATH_INFO: `/v3/projects/16e6bec2943a4305b68ae4edfde04c42` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.058222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e6bec2943a4305b68ae4edfde04c42)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:14.060166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:14.104352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e6bec2943a4305b68ae4edfde04c42', 'request_id': 'req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:14.110055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e6bec2943a4305b68ae4edfde04c42', 'request_id': 'req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:14.115321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e6bec2943a4305b68ae4edfde04c42', 'request_id': 'req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:14.127195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] The token cache is being invalidate because project 16e6bec2943a4305b68ae4edfde04c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:14.127485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:14.128130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0ef090aa-ff15-4bb6-8f7f-1e1e2e0a9f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:14.129613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1071/2107] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:13 2021] DELETE /identity/v3/projects/16e6bec2943a4305b68ae4edfde04c42 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:14.135566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff873dd-3e9b-457a-8476-6ae5f49e4cdc None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.136057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff873dd-3e9b-457a-8476-6ae5f49e4cdc None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.136281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff873dd-3e9b-457a-8476-6ae5f49e4cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.154198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-8ff873dd-3e9b-457a-8476-6ae5f49e4cdc None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:14.155418 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8ff873dd-3e9b-457a-8476-6ae5f49e4cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:14.212647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1037/2108] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:14.220702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132eb2a-60c3-412e-a1d3-3753ba603e41 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.220986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132eb2a-60c3-412e-a1d3-3753ba603e41 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.221263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132eb2a-60c3-412e-a1d3-3753ba603e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.239782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8132eb2a-60c3-412e-a1d3-3753ba603e41 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:14.240974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8132eb2a-60c3-412e-a1d3-3753ba603e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:14.249681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1072/2109] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:14.253926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff873dd-3e9b-457a-8476-6ae5f49e4cdc None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:14.263486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff873dd-3e9b-457a-8476-6ae5f49e4cdc None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:14.268999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643ae98-8dc7-4eb3-b275-a1fc506ed09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:14.269663 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643ae98-8dc7-4eb3-b275-a1fc506ed09b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.269944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643ae98-8dc7-4eb3-b275-a1fc506ed09b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.270221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643ae98-8dc7-4eb3-b275-a1fc506ed09b admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.270972 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643ae98-8dc7-4eb3-b275-a1fc506ed09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:14.271281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643ae98-8dc7-4eb3-b275-a1fc506ed09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:14.272882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643ae98-8dc7-4eb3-b275-a1fc506ed09b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:14.284937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1038/2110] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:28:14.289287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132eb2a-60c3-412e-a1d3-3753ba603e41 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:14.298249 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132eb2a-60c3-412e-a1d3-3753ba603e41 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:14.302822 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002a819-8b59-41a1-8751-0a5563d8355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:14.303466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002a819-8b59-41a1-8751-0a5563d8355c admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.303744 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002a819-8b59-41a1-8751-0a5563d8355c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.304017 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002a819-8b59-41a1-8751-0a5563d8355c admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.304686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002a819-8b59-41a1-8751-0a5563d8355c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:14.306557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002a819-8b59-41a1-8751-0a5563d8355c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:14.330825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1073/2111] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:14 2021] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:14.335497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643ae98-8dc7-4eb3-b275-a1fc506ed09b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:14.346294 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643ae98-8dc7-4eb3-b275-a1fc506ed09b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:14.407233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baabbf6-0064-4446-ac49-f5dea735e049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:14.408079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baabbf6-0064-4446-ac49-f5dea735e049 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.408366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baabbf6-0064-4446-ac49-f5dea735e049 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.408642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baabbf6-0064-4446-ac49-f5dea735e049 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.409366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baabbf6-0064-4446-ac49-f5dea735e049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:14.411347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baabbf6-0064-4446-ac49-f5dea735e049 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:14.434194 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1039/2112] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:14 2021] POST /identity/v3/users => generated 281 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:14.438081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002a819-8b59-41a1-8751-0a5563d8355c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:14.452160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002a819-8b59-41a1-8751-0a5563d8355c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:14.458245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba92365-315e-4916-8c2b-2f3ef40144b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:14.458943 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba92365-315e-4916-8c2b-2f3ef40144b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.459229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba92365-315e-4916-8c2b-2f3ef40144b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.459505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba92365-315e-4916-8c2b-2f3ef40144b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.460223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba92365-315e-4916-8c2b-2f3ef40144b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:14.461813 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba92365-315e-4916-8c2b-2f3ef40144b3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:14.472849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1074/2113] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:14 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:14.477246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baabbf6-0064-4446-ac49-f5dea735e049 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:14.487860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baabbf6-0064-4446-ac49-f5dea735e049 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:14.493423 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4eadf-303c-438e-8c95-5f0d3ede6375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:14.494095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4eadf-303c-438e-8c95-5f0d3ede6375 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.494382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4eadf-303c-438e-8c95-5f0d3ede6375 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.494662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4eadf-303c-438e-8c95-5f0d3ede6375 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.495414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4eadf-303c-438e-8c95-5f0d3ede6375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:14.497031 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4eadf-303c-438e-8c95-5f0d3ede6375 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:14.510950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1040/2114] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:14.512264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba92365-315e-4916-8c2b-2f3ef40144b3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:14.523040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba92365-315e-4916-8c2b-2f3ef40144b3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:14.528055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7884f-9886-402d-97ac-9cfb7e648cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:14.528946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7884f-9886-402d-97ac-9cfb7e648cec admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.529246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7884f-9886-402d-97ac-9cfb7e648cec admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.529617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7884f-9886-402d-97ac-9cfb7e648cec admin admin] PATH_INFO: `/v3/projects/aa47c2b776ca459ca5fbc7da1b99909c/users/81b907c5a8d34adeb7d2c16a4dccaac9/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.546167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7884f-9886-402d-97ac-9cfb7e648cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa47c2b776ca459ca5fbc7da1b99909c, user_id=81b907c5a8d34adeb7d2c16a4dccaac9, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:14.549053 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7884f-9886-402d-97ac-9cfb7e648cec admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:14.559180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4eadf-303c-438e-8c95-5f0d3ede6375 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:14.560891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a6a4eadf-303c-438e-8c95-5f0d3ede6375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:14.564787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1075/2115] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:14 2021] PUT /identity/v3/projects/aa47c2b776ca459ca5fbc7da1b99909c/users/81b907c5a8d34adeb7d2c16a4dccaac9/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:14.574845 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4eadf-303c-438e-8c95-5f0d3ede6375 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:14.578564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11d59-22c1-4446-991c-a3892f44c53f None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.578928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11d59-22c1-4446-991c-a3892f44c53f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.579177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11d59-22c1-4446-991c-a3892f44c53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.609529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-72e11d59-22c1-4446-991c-a3892f44c53f None None] MFA Rules not processed for user `81b907c5a8d34adeb7d2c16a4dccaac9`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:14.610942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-72e11d59-22c1-4446-991c-a3892f44c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:14.643236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:14.645064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.645351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.645796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] PATH_INFO: `/v3/users/1f36aa7d020945b1a30d3f5e925f16ab` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.647394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f36aa7d020945b1a30d3f5e925f16ab)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:14.649363 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:14.725150 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1076/2116] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:14 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:14.749229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f36aa7d020945b1a30d3f5e925f16ab'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:14.749229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f36aa7d020945b1a30d3f5e925f16ab'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:14.749684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f36aa7d020945b1a30d3f5e925f16ab'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:14.750464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f36aa7d020945b1a30d3f5e925f16ab'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:14.762306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f36aa7d020945b1a30d3f5e925f16ab'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:14.804386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1041/2117] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:14 2021] DELETE /identity/v3/users/1f36aa7d020945b1a30d3f5e925f16ab => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:14.809446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36776bd4-258c-4c97-b236-f2b208584772 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.809738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36776bd4-258c-4c97-b236-f2b208584772 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.810073 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36776bd4-258c-4c97-b236-f2b208584772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.842462 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:14.844014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:14.852145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-36776bd4-258c-4c97-b236-f2b208584772 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:14.853720 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-36776bd4-258c-4c97-b236-f2b208584772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:14.905560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c990756-d1b3-492f-91fb-8d1b79be3a7e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:14.910018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445298bd-b130-4345-b100-19d7599f4e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:14.910765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445298bd-b130-4345-b100-19d7599f4e24 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.911089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445298bd-b130-4345-b100-19d7599f4e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.911401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445298bd-b130-4345-b100-19d7599f4e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.913500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-445298bd-b130-4345-b100-19d7599f4e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:14.919875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1077/2118] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:14.921573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0684-9b9b-40a8-9893-ac4b0d603886 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:14.921959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0684-9b9b-40a8-9893-ac4b0d603886 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:14.922364 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0684-9b9b-40a8-9893-ac4b0d603886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:14.941286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c3eb0684-9b9b-40a8-9893-ac4b0d603886 None None] MFA Rules not processed for user `d2f7490ad6cf4bed96cfec8a39a65b43`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:14.942654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c3eb0684-9b9b-40a8-9893-ac4b0d603886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:14.988765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445298bd-b130-4345-b100-19d7599f4e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:14.990217 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445298bd-b130-4345-b100-19d7599f4e24 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:14.998760 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1078/2119] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:14 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:14.999632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0684-9b9b-40a8-9893-ac4b0d603886 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:15.001131 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c3eb0684-9b9b-40a8-9893-ac4b0d603886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:15.006355 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1042/2120] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:14 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:15.022060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445298bd-b130-4345-b100-19d7599f4e24 service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:15.023627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-445298bd-b130-4345-b100-19d7599f4e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:15.046459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445298bd-b130-4345-b100-19d7599f4e24 service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:15.059732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:15.060925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:15.061323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:15.061827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] PATH_INFO: `/v3/users/81b907c5a8d34adeb7d2c16a4dccaac9` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:15.063381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b907c5a8d34adeb7d2c16a4dccaac9)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:15.066198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:15.086726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0684-9b9b-40a8-9893-ac4b0d603886 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:15.098016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d396d-f06d-4995-b62a-17d522cea1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:15.098915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d396d-f06d-4995-b62a-17d522cea1ab service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:15.099313 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d396d-f06d-4995-b62a-17d522cea1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:15.099695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d396d-f06d-4995-b62a-17d522cea1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:15.109963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d396d-f06d-4995-b62a-17d522cea1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:15.111559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d396d-f06d-4995-b62a-17d522cea1ab service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:15.122533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1079/2121] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:15.128923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b907c5a8d34adeb7d2c16a4dccaac9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.135748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b907c5a8d34adeb7d2c16a4dccaac9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.136440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b907c5a8d34adeb7d2c16a4dccaac9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.137090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b907c5a8d34adeb7d2c16a4dccaac9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.146011 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b907c5a8d34adeb7d2c16a4dccaac9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.168321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1043/2122] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:15 2021] DELETE /identity/v3/users/81b907c5a8d34adeb7d2c16a4dccaac9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:15.172566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f8e2-d2e1-48d0-9c41-f1bb5817b4f7 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:15.172926 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f8e2-d2e1-48d0-9c41-f1bb5817b4f7 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:15.173271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f8e2-d2e1-48d0-9c41-f1bb5817b4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:15.193232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-ae70f8e2-d2e1-48d0-9c41-f1bb5817b4f7 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:15.194910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ae70f8e2-d2e1-48d0-9c41-f1bb5817b4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:15.265508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1080/2123] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:15.274991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:15.277427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:15.350348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511532df-1f96-49bf-9ac0-143daedfa65f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:15.354103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fc6bb-89b8-411d-b8e2-f878ac27eb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:15.354860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc6bb-89b8-411d-b8e2-f878ac27eb9a service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:15.355218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc6bb-89b8-411d-b8e2-f878ac27eb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:15.355592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc6bb-89b8-411d-b8e2-f878ac27eb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:15.365128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fc6bb-89b8-411d-b8e2-f878ac27eb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:15.366580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fc6bb-89b8-411d-b8e2-f878ac27eb9a service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:15.376071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1044/2124] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:15.453268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f8e2-d2e1-48d0-9c41-f1bb5817b4f7 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:15.454771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ae70f8e2-d2e1-48d0-9c41-f1bb5817b4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:15.482048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f8e2-d2e1-48d0-9c41-f1bb5817b4f7 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:15.497695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:15.498829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:15.499108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:15.499653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] PATH_INFO: `/v3/projects/36aa782d8eaa45fea12bb81ba60936aa` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:15.501085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=36aa782d8eaa45fea12bb81ba60936aa)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:15.503553 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:15.551489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36aa782d8eaa45fea12bb81ba60936aa', 'request_id': 'req-b9e83943-136a-4055-ac89-8dde1782c0cb'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.558224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36aa782d8eaa45fea12bb81ba60936aa', 'request_id': 'req-b9e83943-136a-4055-ac89-8dde1782c0cb'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.566125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36aa782d8eaa45fea12bb81ba60936aa', 'request_id': 'req-b9e83943-136a-4055-ac89-8dde1782c0cb'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.580045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] The token cache is being invalidate because project 36aa782d8eaa45fea12bb81ba60936aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:15.580495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.581265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.582993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1081/2125] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:15 2021] DELETE /identity/v3/projects/36aa782d8eaa45fea12bb81ba60936aa => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:15.587276 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fc6bb-89b8-411d-b8e2-f878ac27eb9a service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:15.597531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fc6bb-89b8-411d-b8e2-f878ac27eb9a service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:15.658240 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:15.659275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:15.660472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:15.660814 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] PATH_INFO: `/v3/users/9d4ac223916e4176a5ec27f55d6a1360` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:15.662026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4ac223916e4176a5ec27f55d6a1360)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:15.664007 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:15.714455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4ac223916e4176a5ec27f55d6a1360'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.716289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:15.719834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:15.722596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4ac223916e4176a5ec27f55d6a1360'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.723493 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4ac223916e4176a5ec27f55d6a1360'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.724619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4ac223916e4176a5ec27f55d6a1360'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.734566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-1ee0cb61-3eff-42f3-a319-43a0a7d48e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4ac223916e4176a5ec27f55d6a1360'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.736255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83943-136a-4055-ac89-8dde1782c0cb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:15.742613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:15.743566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:15.743852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:15.744135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] PATH_INFO: `/v3/projects/aa47c2b776ca459ca5fbc7da1b99909c` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:15.745390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa47c2b776ca459ca5fbc7da1b99909c)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:15.747410 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:15.769047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1045/2126] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:15 2021] DELETE /identity/v3/users/9d4ac223916e4176a5ec27f55d6a1360 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:15.798055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa47c2b776ca459ca5fbc7da1b99909c', 'request_id': 'req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.805828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa47c2b776ca459ca5fbc7da1b99909c', 'request_id': 'req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.819520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa47c2b776ca459ca5fbc7da1b99909c', 'request_id': 'req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.833645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] The token cache is being invalidate because project aa47c2b776ca459ca5fbc7da1b99909c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:15.833984 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.834968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dc0a3d9e-25f5-4a5d-aa24-c98300ae245f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:15.841252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1082/2127] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:15 2021] DELETE /identity/v3/projects/aa47c2b776ca459ca5fbc7da1b99909c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:15.843213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a206c-a87f-4718-aef2-2502e085604b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:15.843505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a206c-a87f-4718-aef2-2502e085604b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:15.843785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a206c-a87f-4718-aef2-2502e085604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:15.865046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-ab0a206c-a87f-4718-aef2-2502e085604b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:15.866311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ab0a206c-a87f-4718-aef2-2502e085604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:15.929891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1046/2128] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:15.937588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dad85-6e8e-4819-8d0b-ac37ddccf75c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:15.937888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dad85-6e8e-4819-8d0b-ac37ddccf75c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:15.938170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dad85-6e8e-4819-8d0b-ac37ddccf75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:15.962738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8a4dad85-6e8e-4819-8d0b-ac37ddccf75c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:15.964664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8a4dad85-6e8e-4819-8d0b-ac37ddccf75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:15.973438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1083/2129] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:15.977859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a206c-a87f-4718-aef2-2502e085604b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:15.988317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a206c-a87f-4718-aef2-2502e085604b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:15.993353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6771-5541-40b7-8171-d15995689f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:15.994012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6771-5541-40b7-8171-d15995689f21 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:15.994298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6771-5541-40b7-8171-d15995689f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:15.994576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6771-5541-40b7-8171-d15995689f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:15.995336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6771-5541-40b7-8171-d15995689f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:15.995644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6771-5541-40b7-8171-d15995689f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:15.997233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6771-5541-40b7-8171-d15995689f21 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.008672 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1047/2130] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:28:16.012944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dad85-6e8e-4819-8d0b-ac37ddccf75c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.022937 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dad85-6e8e-4819-8d0b-ac37ddccf75c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.028280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17113a8-f4aa-4ff0-9e5a-71e27173c7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.029175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17113a8-f4aa-4ff0-9e5a-71e27173c7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.029293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17113a8-f4aa-4ff0-9e5a-71e27173c7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.029495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17113a8-f4aa-4ff0-9e5a-71e27173c7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.030192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17113a8-f4aa-4ff0-9e5a-71e27173c7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.032211 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17113a8-f4aa-4ff0-9e5a-71e27173c7f3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.062075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1084/2131] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:16.066049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6771-5541-40b7-8171-d15995689f21 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.077899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6771-5541-40b7-8171-d15995689f21 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.149616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3f32d-e6a4-48bc-b475-947618b4a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.151028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f32d-e6a4-48bc-b475-947618b4a27e admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.151500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f32d-e6a4-48bc-b475-947618b4a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.151815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f32d-e6a4-48bc-b475-947618b4a27e admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.152886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3f32d-e6a4-48bc-b475-947618b4a27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.155067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3f32d-e6a4-48bc-b475-947618b4a27e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.167082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17113a8-f4aa-4ff0-9e5a-71e27173c7f3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.169096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e17113a8-f4aa-4ff0-9e5a-71e27173c7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:16.188174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1048/2132] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:16.188431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17113a8-f4aa-4ff0-9e5a-71e27173c7f3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.192124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3f32d-e6a4-48bc-b475-947618b4a27e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.196591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.197492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.197784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.198066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] PATH_INFO: `/v3/projects/a9ea4cc121cd44ce99d6d858160369f5` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.199297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ea4cc121cd44ce99d6d858160369f5)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.202632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.204497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3f32d-e6a4-48bc-b475-947618b4a27e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.210476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749579-bec2-486d-b622-fa2e00d13bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.211102 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749579-bec2-486d-b622-fa2e00d13bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.211398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749579-bec2-486d-b622-fa2e00d13bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.211776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749579-bec2-486d-b622-fa2e00d13bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.212499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c749579-bec2-486d-b622-fa2e00d13bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.214342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c749579-bec2-486d-b622-fa2e00d13bf9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.227508 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1049/2133] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:16 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:16.230656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749579-bec2-486d-b622-fa2e00d13bf9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.241568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749579-bec2-486d-b622-fa2e00d13bf9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.247796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea597995-d1de-4fa9-9df5-736727ea523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.248588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea597995-d1de-4fa9-9df5-736727ea523f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.248939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea597995-d1de-4fa9-9df5-736727ea523f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.249248 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea597995-d1de-4fa9-9df5-736727ea523f admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.250098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea597995-d1de-4fa9-9df5-736727ea523f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.251707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea597995-d1de-4fa9-9df5-736727ea523f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.262873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1050/2134] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:16 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:16.267032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea597995-d1de-4fa9-9df5-736727ea523f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.271283 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ea4cc121cd44ce99d6d858160369f5', 'request_id': 'req-ae338cbc-a243-400d-a2fa-b795fe63b4f0'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:16.276670 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea597995-d1de-4fa9-9df5-736727ea523f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.277929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ea4cc121cd44ce99d6d858160369f5', 'request_id': 'req-ae338cbc-a243-400d-a2fa-b795fe63b4f0'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:16.283564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ea4cc121cd44ce99d6d858160369f5', 'request_id': 'req-ae338cbc-a243-400d-a2fa-b795fe63b4f0'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:16.295922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] The token cache is being invalidate because project a9ea4cc121cd44ce99d6d858160369f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:16.296286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:16.296974 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ae338cbc-a243-400d-a2fa-b795fe63b4f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:16.298617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1085/2135] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:16 2021] DELETE /identity/v3/projects/a9ea4cc121cd44ce99d6d858160369f5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:16.304035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1baf9e-3c7b-43a3-888a-e88c20848151 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.304437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1baf9e-3c7b-43a3-888a-e88c20848151 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.304726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1baf9e-3c7b-43a3-888a-e88c20848151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.322315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-9f1baf9e-3c7b-43a3-888a-e88c20848151 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:16.323800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9f1baf9e-3c7b-43a3-888a-e88c20848151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:16.335890 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff8b2-452a-4d79-9d26-4f0edbe39dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.336777 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff8b2-452a-4d79-9d26-4f0edbe39dff admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.337055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff8b2-452a-4d79-9d26-4f0edbe39dff admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.337330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff8b2-452a-4d79-9d26-4f0edbe39dff admin admin] PATH_INFO: `/v3/projects/6918243a36a94e18b1f157fedd510c3a/users/e224cecbe92247c6b8a6c4c008056cf2/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.352199 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff8b2-452a-4d79-9d26-4f0edbe39dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6918243a36a94e18b1f157fedd510c3a, user_id=e224cecbe92247c6b8a6c4c008056cf2, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.354951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff8b2-452a-4d79-9d26-4f0edbe39dff admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.367245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1051/2136] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:16 2021] PUT /identity/v3/projects/6918243a36a94e18b1f157fedd510c3a/users/e224cecbe92247c6b8a6c4c008056cf2/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:16.377393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feade0-1168-4806-b836-df0c30c567ad None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.377682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feade0-1168-4806-b836-df0c30c567ad None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.377990 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feade0-1168-4806-b836-df0c30c567ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.385547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1086/2137] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:16.394815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b046e-b7c9-48e5-aab0-9098bcb20384 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.395116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b046e-b7c9-48e5-aab0-9098bcb20384 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.395401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b046e-b7c9-48e5-aab0-9098bcb20384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.404866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-27feade0-1168-4806-b836-df0c30c567ad None None] MFA Rules not processed for user `e224cecbe92247c6b8a6c4c008056cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:16.406206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-27feade0-1168-4806-b836-df0c30c567ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:16.413649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-fe8b046e-b7c9-48e5-aab0-9098bcb20384 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:16.414830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fe8b046e-b7c9-48e5-aab0-9098bcb20384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:16.472336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1052/2138] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:16.475141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1087/2139] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:16.478509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feade0-1168-4806-b836-df0c30c567ad None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.478509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-27feade0-1168-4806-b836-df0c30c567ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:16.479064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b046e-b7c9-48e5-aab0-9098bcb20384 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.488940 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b046e-b7c9-48e5-aab0-9098bcb20384 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.493785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feade0-1168-4806-b836-df0c30c567ad None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.496505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1b557-6ca9-4ee6-9efe-8db3b46e5859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.497177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1b557-6ca9-4ee6-9efe-8db3b46e5859 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.497478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1b557-6ca9-4ee6-9efe-8db3b46e5859 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.497791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1b557-6ca9-4ee6-9efe-8db3b46e5859 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.498321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a751-fb07-4b91-9099-bb39d8e6d17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.498472 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1b557-6ca9-4ee6-9efe-8db3b46e5859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:16.498796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1b557-6ca9-4ee6-9efe-8db3b46e5859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.498998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a751-fb07-4b91-9099-bb39d8e6d17f admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.499278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a751-fb07-4b91-9099-bb39d8e6d17f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.499552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a751-fb07-4b91-9099-bb39d8e6d17f admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.500235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68a751-fb07-4b91-9099-bb39d8e6d17f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.500420 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1b557-6ca9-4ee6-9efe-8db3b46e5859 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.502146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68a751-fb07-4b91-9099-bb39d8e6d17f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.517286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1088/2140] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:28:16.518396 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1b557-6ca9-4ee6-9efe-8db3b46e5859 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.531323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1053/2141] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:16.531474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1b557-6ca9-4ee6-9efe-8db3b46e5859 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.532515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a751-fb07-4b91-9099-bb39d8e6d17f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.587402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff2adb-9c31-4848-8e3b-81acd3b20e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.588067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2adb-9c31-4848-8e3b-81acd3b20e9e admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.588346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2adb-9c31-4848-8e3b-81acd3b20e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.588618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff2adb-9c31-4848-8e3b-81acd3b20e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.589326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff2adb-9c31-4848-8e3b-81acd3b20e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.591360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff2adb-9c31-4848-8e3b-81acd3b20e9e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.601159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a751-fb07-4b91-9099-bb39d8e6d17f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.611382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fae06-eb67-449b-b5cb-7ce4136039de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.612257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fae06-eb67-449b-b5cb-7ce4136039de admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.612604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fae06-eb67-449b-b5cb-7ce4136039de admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.612936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fae06-eb67-449b-b5cb-7ce4136039de admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.613627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fae06-eb67-449b-b5cb-7ce4136039de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.615724 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fae06-eb67-449b-b5cb-7ce4136039de admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.622745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1089/2142] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:16.623876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff2adb-9c31-4848-8e3b-81acd3b20e9e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.641836 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1054/2143] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:16.643560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fae06-eb67-449b-b5cb-7ce4136039de admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.654325 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fae06-eb67-449b-b5cb-7ce4136039de admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.686949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff2adb-9c31-4848-8e3b-81acd3b20e9e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.692061 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c683d-269a-4bc0-aa96-a3bf6e695cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.692726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c683d-269a-4bc0-aa96-a3bf6e695cce admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.693032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c683d-269a-4bc0-aa96-a3bf6e695cce admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.693337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c683d-269a-4bc0-aa96-a3bf6e695cce admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.694010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c683d-269a-4bc0-aa96-a3bf6e695cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.695948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c683d-269a-4bc0-aa96-a3bf6e695cce admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.710957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c607dd7-2613-4811-b823-3b25af949f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.711742 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c607dd7-2613-4811-b823-3b25af949f44 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.712172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c607dd7-2613-4811-b823-3b25af949f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.712644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c607dd7-2613-4811-b823-3b25af949f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.713677 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c607dd7-2613-4811-b823-3b25af949f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.715938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1090/2144] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:16.716068 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c607dd7-2613-4811-b823-3b25af949f44 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.719979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c683d-269a-4bc0-aa96-a3bf6e695cce admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.727386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1055/2145] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:16 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:16.729427 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c683d-269a-4bc0-aa96-a3bf6e695cce admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.731409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c607dd7-2613-4811-b823-3b25af949f44 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.734082 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6920e6e-9814-4c77-8264-5eed7c1375ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.734749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6920e6e-9814-4c77-8264-5eed7c1375ba admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.735032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6920e6e-9814-4c77-8264-5eed7c1375ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.735306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6920e6e-9814-4c77-8264-5eed7c1375ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.736042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6920e6e-9814-4c77-8264-5eed7c1375ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.737645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6920e6e-9814-4c77-8264-5eed7c1375ba admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.740906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c607dd7-2613-4811-b823-3b25af949f44 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.745552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3526a-eb6a-41a2-b7e5-f84d357a9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.746512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3526a-eb6a-41a2-b7e5-f84d357a9f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.746828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3526a-eb6a-41a2-b7e5-f84d357a9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.747216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3526a-eb6a-41a2-b7e5-f84d357a9f4f admin admin] PATH_INFO: `/v3/projects/53dbd11b52f440cdba0f93e8839bea8b/users/2ac9fa65c3ac46cb89206b807c7faa85/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.747648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1091/2146] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:16 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:16.751074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6920e6e-9814-4c77-8264-5eed7c1375ba admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.761170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6920e6e-9814-4c77-8264-5eed7c1375ba admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.762381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3526a-eb6a-41a2-b7e5-f84d357a9f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53dbd11b52f440cdba0f93e8839bea8b, user_id=2ac9fa65c3ac46cb89206b807c7faa85, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.766032 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3526a-eb6a-41a2-b7e5-f84d357a9f4f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.766176 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5919e18-0071-4a19-b4c4-d23b4f065d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.766866 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5919e18-0071-4a19-b4c4-d23b4f065d1e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.767153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5919e18-0071-4a19-b4c4-d23b4f065d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.767417 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5919e18-0071-4a19-b4c4-d23b4f065d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.768132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5919e18-0071-4a19-b4c4-d23b4f065d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.770268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5919e18-0071-4a19-b4c4-d23b4f065d1e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.780900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1092/2147] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:16.781280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1056/2148] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:16 2021] PUT /identity/v3/projects/53dbd11b52f440cdba0f93e8839bea8b/users/2ac9fa65c3ac46cb89206b807c7faa85/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:16.785253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5919e18-0071-4a19-b4c4-d23b4f065d1e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.785375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3526a-eb6a-41a2-b7e5-f84d357a9f4f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.794791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5919e18-0071-4a19-b4c4-d23b4f065d1e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.854274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3526a-eb6a-41a2-b7e5-f84d357a9f4f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.858669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e8da3-7b66-497a-85c1-de200fd0e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.859064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bb93c-ed0a-40e5-bbad-607c29d7d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.859369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e8da3-7b66-497a-85c1-de200fd0e9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.859652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e8da3-7b66-497a-85c1-de200fd0e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.859926 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e8da3-7b66-497a-85c1-de200fd0e9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.860028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bb93c-ed0a-40e5-bbad-607c29d7d120 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.860213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bb93c-ed0a-40e5-bbad-607c29d7d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.860547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bb93c-ed0a-40e5-bbad-607c29d7d120 admin admin] PATH_INFO: `/v3/projects/df169871edac44af80137721fc3b1cbe/users/4e521fda865d4693bccc407737e8c0cc/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.860785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e8da3-7b66-497a-85c1-de200fd0e9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.862585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e8da3-7b66-497a-85c1-de200fd0e9d2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.873316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1093/2149] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:16 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:16.876650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e8da3-7b66-497a-85c1-de200fd0e9d2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:16.883239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bb93c-ed0a-40e5-bbad-607c29d7d120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df169871edac44af80137721fc3b1cbe, user_id=4e521fda865d4693bccc407737e8c0cc, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.885912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bb93c-ed0a-40e5-bbad-607c29d7d120 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.886667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e8da3-7b66-497a-85c1-de200fd0e9d2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:16.892958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea87016-943f-41cb-80a9-f2a50ca00fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:16.894487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea87016-943f-41cb-80a9-f2a50ca00fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.894764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea87016-943f-41cb-80a9-f2a50ca00fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.895091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea87016-943f-41cb-80a9-f2a50ca00fa2 admin admin] PATH_INFO: `/v3/projects/53dbd11b52f440cdba0f93e8839bea8b/users/2ac9fa65c3ac46cb89206b807c7faa85/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.897183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea87016-943f-41cb-80a9-f2a50ca00fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53dbd11b52f440cdba0f93e8839bea8b, user_id=2ac9fa65c3ac46cb89206b807c7faa85, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:16.899914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea87016-943f-41cb-80a9-f2a50ca00fa2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:16.902180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1057/2150] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:16 2021] PUT /identity/v3/projects/df169871edac44af80137721fc3b1cbe/users/4e521fda865d4693bccc407737e8c0cc/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:16.911134 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1094/2151] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:16 2021] PUT /identity/v3/projects/53dbd11b52f440cdba0f93e8839bea8b/users/2ac9fa65c3ac46cb89206b807c7faa85/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:16.915665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82468-f887-4a66-81fd-2b61b078c578 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.916211 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82468-f887-4a66-81fd-2b61b078c578 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.916693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82468-f887-4a66-81fd-2b61b078c578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.922843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b5a3-b993-482f-9aa5-f2399d495498 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:16.923127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b5a3-b993-482f-9aa5-f2399d495498 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:16.923409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b5a3-b993-482f-9aa5-f2399d495498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:16.949423 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c8c82468-f887-4a66-81fd-2b61b078c578 None None] MFA Rules not processed for user `4e521fda865d4693bccc407737e8c0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:16.950633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c8c82468-f887-4a66-81fd-2b61b078c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:16.951421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-14c8b5a3-b993-482f-9aa5-f2399d495498 None None] MFA Rules not processed for user `2ac9fa65c3ac46cb89206b807c7faa85`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:16.952634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-14c8b5a3-b993-482f-9aa5-f2399d495498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:17.014232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1058/2152] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:17.018136 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c82468-f887-4a66-81fd-2b61b078c578 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:17.020910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1095/2153] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:16 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:17.036676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b5a3-b993-482f-9aa5-f2399d495498 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:17.038114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-14c8b5a3-b993-482f-9aa5-f2399d495498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:17.094203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c82468-f887-4a66-81fd-2b61b078c578 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:17.099169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b51e5-a5d0-4f81-b8b7-a2f5545c7db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:17.099829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b51e5-a5d0-4f81-b8b7-a2f5545c7db7 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:17.100109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b51e5-a5d0-4f81-b8b7-a2f5545c7db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:17.100390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b51e5-a5d0-4f81-b8b7-a2f5545c7db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:17.101225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b51e5-a5d0-4f81-b8b7-a2f5545c7db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:17.103304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b51e5-a5d0-4f81-b8b7-a2f5545c7db7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:17.126714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b5a3-b993-482f-9aa5-f2399d495498 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:17.131263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b63ea4-d1d8-4720-8917-f8baeb9359c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:17.131932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63ea4-d1d8-4720-8917-f8baeb9359c0 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:17.132235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63ea4-d1d8-4720-8917-f8baeb9359c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:17.132509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63ea4-d1d8-4720-8917-f8baeb9359c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:17.151454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1059/2154] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:17 2021] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:17.155084 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b51e5-a5d0-4f81-b8b7-a2f5545c7db7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:17.218716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b63ea4-d1d8-4720-8917-f8baeb9359c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:17.220350 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b63ea4-d1d8-4720-8917-f8baeb9359c0 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:17.236229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1096/2155] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:17 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:28:17.244909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b51e5-a5d0-4f81-b8b7-a2f5545c7db7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:17.254565 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ef88c-5dc7-400a-8536-533193bdc1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:17.255521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ef88c-5dc7-400a-8536-533193bdc1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:17.256023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ef88c-5dc7-400a-8536-533193bdc1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:17.256443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ef88c-5dc7-400a-8536-533193bdc1c6 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:17.257353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ef88c-5dc7-400a-8536-533193bdc1c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:17.259524 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ef88c-5dc7-400a-8536-533193bdc1c6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:17.282598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1060/2156] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:17 2021] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:17.287677 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b63ea4-d1d8-4720-8917-f8baeb9359c0 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:17.303044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b63ea4-d1d8-4720-8917-f8baeb9359c0 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:17.308837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96abe83-f00c-4733-897d-ffa13e50fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:17.309670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96abe83-f00c-4733-897d-ffa13e50fac5 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:17.309950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96abe83-f00c-4733-897d-ffa13e50fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:17.310227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96abe83-f00c-4733-897d-ffa13e50fac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:17.311015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96abe83-f00c-4733-897d-ffa13e50fac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:17.312778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96abe83-f00c-4733-897d-ffa13e50fac5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:17.324631 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1097/2157] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:17 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:17.329165 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ef88c-5dc7-400a-8536-533193bdc1c6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:17.348999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ef88c-5dc7-400a-8536-533193bdc1c6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:17.355488 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cf410-9067-4705-b911-08f8a90cf514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:17.356506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cf410-9067-4705-b911-08f8a90cf514 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:17.357017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cf410-9067-4705-b911-08f8a90cf514 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:17.357757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cf410-9067-4705-b911-08f8a90cf514 admin admin] PATH_INFO: `/v3/projects/5945d5b705e445f59d0d6593ef9514fa/users/bee6d03520ec41fda5b518a36de1e640/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:17.375969 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cf410-9067-4705-b911-08f8a90cf514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5945d5b705e445f59d0d6593ef9514fa, user_id=bee6d03520ec41fda5b518a36de1e640, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:17.382251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cf410-9067-4705-b911-08f8a90cf514 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:17.399364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1061/2158] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:17 2021] PUT /identity/v3/projects/5945d5b705e445f59d0d6593ef9514fa/users/bee6d03520ec41fda5b518a36de1e640/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:17.403304 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96abe83-f00c-4733-897d-ffa13e50fac5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:17.422789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96abe83-f00c-4733-897d-ffa13e50fac5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:17.496765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f4468-4576-4dd9-a150-574d2b1223ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:17.497444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f4468-4576-4dd9-a150-574d2b1223ec admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:17.497722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f4468-4576-4dd9-a150-574d2b1223ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:17.498008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f4468-4576-4dd9-a150-574d2b1223ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:17.498738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f4468-4576-4dd9-a150-574d2b1223ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:17.500332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f4468-4576-4dd9-a150-574d2b1223ec admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:17.511286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1098/2159] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:17 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:17.515350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cf410-9067-4705-b911-08f8a90cf514 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:17.528731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cf410-9067-4705-b911-08f8a90cf514 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:17.533753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e03f00-9baf-4a70-981a-293322a665fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:17.535309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03f00-9baf-4a70-981a-293322a665fb admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:17.535840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03f00-9baf-4a70-981a-293322a665fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:17.536200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03f00-9baf-4a70-981a-293322a665fb admin admin] PATH_INFO: `/v3/projects/5945d5b705e445f59d0d6593ef9514fa/users/bee6d03520ec41fda5b518a36de1e640/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:17.538466 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e03f00-9baf-4a70-981a-293322a665fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5945d5b705e445f59d0d6593ef9514fa, user_id=bee6d03520ec41fda5b518a36de1e640, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:17.541419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e03f00-9baf-4a70-981a-293322a665fb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:17.553995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1062/2160] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:17 2021] PUT /identity/v3/projects/5945d5b705e445f59d0d6593ef9514fa/users/bee6d03520ec41fda5b518a36de1e640/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:17.564644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf1913-46ea-456e-ba67-2dd97237ae3f None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:17.564945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf1913-46ea-456e-ba67-2dd97237ae3f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:17.565496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf1913-46ea-456e-ba67-2dd97237ae3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:17.595125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-90cf1913-46ea-456e-ba67-2dd97237ae3f None None] MFA Rules not processed for user `bee6d03520ec41fda5b518a36de1e640`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:17.596440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-90cf1913-46ea-456e-ba67-2dd97237ae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:17.693777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1099/2161] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:17 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:17.704170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e03f00-9baf-4a70-981a-293322a665fb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:17.756534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e03f00-9baf-4a70-981a-293322a665fb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:17.760147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feea484-c33c-4391-bcb8-6d2f1c5f3f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:17.760790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feea484-c33c-4391-bcb8-6d2f1c5f3f02 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:17.761071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feea484-c33c-4391-bcb8-6d2f1c5f3f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:17.761421 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feea484-c33c-4391-bcb8-6d2f1c5f3f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:17.771437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feea484-c33c-4391-bcb8-6d2f1c5f3f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:17.772790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feea484-c33c-4391-bcb8-6d2f1c5f3f02 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:17.782044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1063/2162] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:17 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:17.864044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf1913-46ea-456e-ba67-2dd97237ae3f None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:17.873523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf1913-46ea-456e-ba67-2dd97237ae3f None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:17.877425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddec16-50c6-4f35-874d-551217148142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:17.878907 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddec16-50c6-4f35-874d-551217148142 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:17.879093 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddec16-50c6-4f35-874d-551217148142 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:17.879365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddec16-50c6-4f35-874d-551217148142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:17.936676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddec16-50c6-4f35-874d-551217148142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:17.938149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddec16-50c6-4f35-874d-551217148142 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:17.947437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1100/2163] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:17 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:19.889966 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feea484-c33c-4391-bcb8-6d2f1c5f3f02 service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:19.950121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feea484-c33c-4391-bcb8-6d2f1c5f3f02 service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:19.954522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:19.955390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:19.955667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:19.955935 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] PATH_INFO: `/v3/users/e224cecbe92247c6b8a6c4c008056cf2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:19.957205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e224cecbe92247c6b8a6c4c008056cf2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:19.959142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:20.007460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e224cecbe92247c6b8a6c4c008056cf2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.014504 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e224cecbe92247c6b8a6c4c008056cf2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.015235 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e224cecbe92247c6b8a6c4c008056cf2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.015844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e224cecbe92247c6b8a6c4c008056cf2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.023391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e224cecbe92247c6b8a6c4c008056cf2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.040861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1064/2164] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:19 2021] DELETE /identity/v3/users/e224cecbe92247c6b8a6c4c008056cf2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:20.045937 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938ad2-d755-4ed3-a83f-ada2b1a76166 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:20.046463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938ad2-d755-4ed3-a83f-ada2b1a76166 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:20.046575 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938ad2-d755-4ed3-a83f-ada2b1a76166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:20.068230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-34938ad2-d755-4ed3-a83f-ada2b1a76166 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:20.069481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-34938ad2-d755-4ed3-a83f-ada2b1a76166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:20.139094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1101/2165] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:20.141599 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:20.143031 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:20.212882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f906a-c1ce-443c-a482-045dfa38af4f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:20.216508 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b3827-3af2-4bc6-8f05-6ed002adf782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:20.217155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b3827-3af2-4bc6-8f05-6ed002adf782 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:20.217435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b3827-3af2-4bc6-8f05-6ed002adf782 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:20.217710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b3827-3af2-4bc6-8f05-6ed002adf782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:20.226413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b3827-3af2-4bc6-8f05-6ed002adf782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:20.227866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b3827-3af2-4bc6-8f05-6ed002adf782 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:20.236968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1065/2166] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:20.527994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938ad2-d755-4ed3-a83f-ada2b1a76166 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:20.529761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-34938ad2-d755-4ed3-a83f-ada2b1a76166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:20.560436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938ad2-d755-4ed3-a83f-ada2b1a76166 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:20.569147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:20.570016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:20.570293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:20.570576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] PATH_INFO: `/v3/projects/6918243a36a94e18b1f157fedd510c3a` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:20.574886 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6918243a36a94e18b1f157fedd510c3a)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:20.577272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:20.634759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6918243a36a94e18b1f157fedd510c3a', 'request_id': 'req-8767d4b6-59ca-4291-a094-970e41b69105'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.641694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6918243a36a94e18b1f157fedd510c3a', 'request_id': 'req-8767d4b6-59ca-4291-a094-970e41b69105'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.647957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6918243a36a94e18b1f157fedd510c3a', 'request_id': 'req-8767d4b6-59ca-4291-a094-970e41b69105'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.672707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] The token cache is being invalidate because project 6918243a36a94e18b1f157fedd510c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:20.672707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.672707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.672707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1102/2167] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:20 2021] DELETE /identity/v3/projects/6918243a36a94e18b1f157fedd510c3a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:20.675142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b3827-3af2-4bc6-8f05-6ed002adf782 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:20.685661 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b3827-3af2-4bc6-8f05-6ed002adf782 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:20.755118 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:20.756022 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:20.756514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:20.756795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] PATH_INFO: `/v3/users/2ac9fa65c3ac46cb89206b807c7faa85` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:20.758005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac9fa65c3ac46cb89206b807c7faa85)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:20.759975 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:20.824881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac9fa65c3ac46cb89206b807c7faa85'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.835079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac9fa65c3ac46cb89206b807c7faa85'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.835956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac9fa65c3ac46cb89206b807c7faa85'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.836569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac9fa65c3ac46cb89206b807c7faa85'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.845647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-dcd9158d-1d35-40c7-bd78-694c18bbbd09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac9fa65c3ac46cb89206b807c7faa85'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:20.872914 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1066/2168] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:20 2021] DELETE /identity/v3/users/2ac9fa65c3ac46cb89206b807c7faa85 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:21.174882 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:21.176861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:21.210138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767d4b6-59ca-4291-a094-970e41b69105 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:21.266527 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:21.267335 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.267620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.267895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] PATH_INFO: `/v3/projects/53dbd11b52f440cdba0f93e8839bea8b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.269997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53dbd11b52f440cdba0f93e8839bea8b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:21.272052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:21.324790 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53dbd11b52f440cdba0f93e8839bea8b', 'request_id': 'req-ca539081-5ccb-4146-aea1-4df9b92ea906'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:21.331064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53dbd11b52f440cdba0f93e8839bea8b', 'request_id': 'req-ca539081-5ccb-4146-aea1-4df9b92ea906'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:21.339317 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53dbd11b52f440cdba0f93e8839bea8b', 'request_id': 'req-ca539081-5ccb-4146-aea1-4df9b92ea906'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:21.353179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] The token cache is being invalidate because project 53dbd11b52f440cdba0f93e8839bea8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:21.353471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:21.354080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ca539081-5ccb-4146-aea1-4df9b92ea906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:21.355677 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1103/2169] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:21 2021] DELETE /identity/v3/projects/53dbd11b52f440cdba0f93e8839bea8b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:21.362870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703ece-0c1c-43c1-9b94-824b960bf68a None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.362870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703ece-0c1c-43c1-9b94-824b960bf68a None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.362870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703ece-0c1c-43c1-9b94-824b960bf68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.387447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a2703ece-0c1c-43c1-9b94-824b960bf68a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:21.388678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a2703ece-0c1c-43c1-9b94-824b960bf68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:21.452628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1067/2170] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:21.461137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06b14-161f-43b8-81dd-9985c65b4f42 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.461432 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06b14-161f-43b8-81dd-9985c65b4f42 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.461713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06b14-161f-43b8-81dd-9985c65b4f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.482122 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-02e06b14-161f-43b8-81dd-9985c65b4f42 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:21.484059 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-02e06b14-161f-43b8-81dd-9985c65b4f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:21.496955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1104/2171] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:21.501437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2703ece-0c1c-43c1-9b94-824b960bf68a None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:21.511420 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2703ece-0c1c-43c1-9b94-824b960bf68a None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:21.516387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d80e4-e5a7-4816-a50c-12100cbadc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:21.516980 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d80e4-e5a7-4816-a50c-12100cbadc3b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.517257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d80e4-e5a7-4816-a50c-12100cbadc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.517530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d80e4-e5a7-4816-a50c-12100cbadc3b admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.518275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d80e4-e5a7-4816-a50c-12100cbadc3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:21.518576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d80e4-e5a7-4816-a50c-12100cbadc3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:21.520815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d80e4-e5a7-4816-a50c-12100cbadc3b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:21.533617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1068/2172] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:28:21.538824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e06b14-161f-43b8-81dd-9985c65b4f42 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:21.548092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e06b14-161f-43b8-81dd-9985c65b4f42 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:21.552748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2857aa-b8f8-4ea9-b9d1-e5611bfcd476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:21.553392 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2857aa-b8f8-4ea9-b9d1-e5611bfcd476 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.553677 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2857aa-b8f8-4ea9-b9d1-e5611bfcd476 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.553957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2857aa-b8f8-4ea9-b9d1-e5611bfcd476 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.554665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2857aa-b8f8-4ea9-b9d1-e5611bfcd476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:21.556658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2857aa-b8f8-4ea9-b9d1-e5611bfcd476 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:21.581157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1105/2173] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:21 2021] POST /identity/v3/projects => generated 399 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:21.586078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d80e4-e5a7-4816-a50c-12100cbadc3b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:21.597144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d80e4-e5a7-4816-a50c-12100cbadc3b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:21.652089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530245a0-c2db-4d7e-820d-94a2131dafe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:21.652757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530245a0-c2db-4d7e-820d-94a2131dafe4 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.653040 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530245a0-c2db-4d7e-820d-94a2131dafe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.653313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530245a0-c2db-4d7e-820d-94a2131dafe4 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.654003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530245a0-c2db-4d7e-820d-94a2131dafe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:21.655922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530245a0-c2db-4d7e-820d-94a2131dafe4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:21.675224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1069/2174] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:21 2021] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:21.679351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2857aa-b8f8-4ea9-b9d1-e5611bfcd476 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:21.689964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2857aa-b8f8-4ea9-b9d1-e5611bfcd476 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:21.694887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63d7c8-f811-448a-96ea-9fbb7125a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:21.695538 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d7c8-f811-448a-96ea-9fbb7125a0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.695819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d7c8-f811-448a-96ea-9fbb7125a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.696095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d7c8-f811-448a-96ea-9fbb7125a0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.696807 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63d7c8-f811-448a-96ea-9fbb7125a0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:21.698389 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63d7c8-f811-448a-96ea-9fbb7125a0c1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:21.708954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1106/2175] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:21.712878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530245a0-c2db-4d7e-820d-94a2131dafe4 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:21.722254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530245a0-c2db-4d7e-820d-94a2131dafe4 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:21.727722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e9bd1-6b67-4e84-81a7-7bc5efa40a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:21.728361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e9bd1-6b67-4e84-81a7-7bc5efa40a79 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.728640 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e9bd1-6b67-4e84-81a7-7bc5efa40a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.728909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e9bd1-6b67-4e84-81a7-7bc5efa40a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.729620 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e9bd1-6b67-4e84-81a7-7bc5efa40a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:21.731360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e9bd1-6b67-4e84-81a7-7bc5efa40a79 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:21.741570 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1070/2176] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:21.745523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63d7c8-f811-448a-96ea-9fbb7125a0c1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:21.755241 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63d7c8-f811-448a-96ea-9fbb7125a0c1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:21.760325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ae294-a233-413f-9445-ebfb90023b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:21.761199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae294-a233-413f-9445-ebfb90023b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.761558 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae294-a233-413f-9445-ebfb90023b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.761746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae294-a233-413f-9445-ebfb90023b0f admin admin] PATH_INFO: `/v3/projects/56ceddf8baf747f28b7b431573982677/users/5e912fb508f2435891aee360dba73b6a/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.777457 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ae294-a233-413f-9445-ebfb90023b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ceddf8baf747f28b7b431573982677, user_id=5e912fb508f2435891aee360dba73b6a, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:21.780180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ae294-a233-413f-9445-ebfb90023b0f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:21.794412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1107/2177] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:21 2021] PUT /identity/v3/projects/56ceddf8baf747f28b7b431573982677/users/5e912fb508f2435891aee360dba73b6a/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:21.805241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5890c-14ed-4d08-8c1d-a0a9d27d2038 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.805519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5890c-14ed-4d08-8c1d-a0a9d27d2038 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.805830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5890c-14ed-4d08-8c1d-a0a9d27d2038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.834477 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-dca5890c-14ed-4d08-8c1d-a0a9d27d2038 None None] MFA Rules not processed for user `5e912fb508f2435891aee360dba73b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:21.835754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-dca5890c-14ed-4d08-8c1d-a0a9d27d2038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:21.901907 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1071/2178] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:21 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:21.912809 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ae294-a233-413f-9445-ebfb90023b0f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:21.914576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3c5ae294-a233-413f-9445-ebfb90023b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:21.970015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ae294-a233-413f-9445-ebfb90023b0f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:21.973602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78742f6-1477-4e48-8c37-6e5cc12691ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:21.974241 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78742f6-1477-4e48-8c37-6e5cc12691ca service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:21.974521 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78742f6-1477-4e48-8c37-6e5cc12691ca service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:21.974836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78742f6-1477-4e48-8c37-6e5cc12691ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:21.983390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78742f6-1477-4e48-8c37-6e5cc12691ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:21.984818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78742f6-1477-4e48-8c37-6e5cc12691ca service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:21.993768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1108/2179] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:21 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:22.695857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5890c-14ed-4d08-8c1d-a0a9d27d2038 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:22.697298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-dca5890c-14ed-4d08-8c1d-a0a9d27d2038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:22.763060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5890c-14ed-4d08-8c1d-a0a9d27d2038 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:22.769367 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:22.770555 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:22.770886 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:22.771170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] PATH_INFO: `/v3/users/4e521fda865d4693bccc407737e8c0cc` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:22.772716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e521fda865d4693bccc407737e8c0cc)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:22.774704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:22.825498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e521fda865d4693bccc407737e8c0cc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:22.832723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e521fda865d4693bccc407737e8c0cc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:22.833449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e521fda865d4693bccc407737e8c0cc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:22.834055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e521fda865d4693bccc407737e8c0cc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:22.841505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e521fda865d4693bccc407737e8c0cc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:22.861750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1072/2180] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:22 2021] DELETE /identity/v3/users/4e521fda865d4693bccc407737e8c0cc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:22.866930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7157ee6-ed14-483a-ad3a-727845f33b30 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:22.867400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7157ee6-ed14-483a-ad3a-727845f33b30 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:22.867522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7157ee6-ed14-483a-ad3a-727845f33b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:22.884528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b7157ee6-ed14-483a-ad3a-727845f33b30 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:22.885731 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b7157ee6-ed14-483a-ad3a-727845f33b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:22.944910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1109/2181] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:22.955199 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:22.957591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:23.020461 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36936d0-5c2a-4f69-ba83-01b34c03fa89 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:23.024653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dda223-d4f5-40e2-bfa5-b5e6472dc351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:23.024895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dda223-d4f5-40e2-bfa5-b5e6472dc351 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:23.025101 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dda223-d4f5-40e2-bfa5-b5e6472dc351 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:23.025373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dda223-d4f5-40e2-bfa5-b5e6472dc351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:23.038515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dda223-d4f5-40e2-bfa5-b5e6472dc351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:23.040275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dda223-d4f5-40e2-bfa5-b5e6472dc351 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:23.049916 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1073/2182] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:23.434967 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7157ee6-ed14-483a-ad3a-727845f33b30 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:23.437490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b7157ee6-ed14-483a-ad3a-727845f33b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:23.448360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7157ee6-ed14-483a-ad3a-727845f33b30 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:23.460580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:23.461443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:23.461720 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:23.461990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] PATH_INFO: `/v3/projects/df169871edac44af80137721fc3b1cbe` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:23.463213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df169871edac44af80137721fc3b1cbe)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:23.465188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:23.521848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df169871edac44af80137721fc3b1cbe', 'request_id': 'req-24b93310-291f-46d9-be4e-198c6af86b0a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:23.527888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df169871edac44af80137721fc3b1cbe', 'request_id': 'req-24b93310-291f-46d9-be4e-198c6af86b0a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:23.533190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df169871edac44af80137721fc3b1cbe', 'request_id': 'req-24b93310-291f-46d9-be4e-198c6af86b0a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:23.546652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] The token cache is being invalidate because project df169871edac44af80137721fc3b1cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:23.547048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:23.547726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:23.549568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1110/2183] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:23 2021] DELETE /identity/v3/projects/df169871edac44af80137721fc3b1cbe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:23.554659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dda223-d4f5-40e2-bfa5-b5e6472dc351 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:23.577750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dda223-d4f5-40e2-bfa5-b5e6472dc351 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:23.646392 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:23.647215 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:23.647501 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:23.648579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] PATH_INFO: `/v3/users/bee6d03520ec41fda5b518a36de1e640` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:23.649023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee6d03520ec41fda5b518a36de1e640)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:23.651064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:23.698450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee6d03520ec41fda5b518a36de1e640'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:23.705438 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee6d03520ec41fda5b518a36de1e640'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:23.706098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee6d03520ec41fda5b518a36de1e640'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:23.706851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee6d03520ec41fda5b518a36de1e640'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:23.714104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4543344b-8a2b-4cba-8b24-5504c8afdfe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee6d03520ec41fda5b518a36de1e640'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:23.731826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1074/2184] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:23 2021] DELETE /identity/v3/users/bee6d03520ec41fda5b518a36de1e640 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:24.016026 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:24.017460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:24.040727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b93310-291f-46d9-be4e-198c6af86b0a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:24.097944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:24.098855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.099140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.099418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] PATH_INFO: `/v3/projects/5945d5b705e445f59d0d6593ef9514fa` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.100598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5945d5b705e445f59d0d6593ef9514fa)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:24.102537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:24.151834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5945d5b705e445f59d0d6593ef9514fa', 'request_id': 'req-41272fa4-cfe6-4057-808a-bb7c44f285d6'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:24.158064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5945d5b705e445f59d0d6593ef9514fa', 'request_id': 'req-41272fa4-cfe6-4057-808a-bb7c44f285d6'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:24.163003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90e17-fc87-41b8-892a-f75c881a6bbe None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.163307 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90e17-fc87-41b8-892a-f75c881a6bbe None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.163588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90e17-fc87-41b8-892a-f75c881a6bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.164566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5945d5b705e445f59d0d6593ef9514fa', 'request_id': 'req-41272fa4-cfe6-4057-808a-bb7c44f285d6'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:24.180919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] The token cache is being invalidate because project 5945d5b705e445f59d0d6593ef9514fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:24.181207 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:24.182044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-41272fa4-cfe6-4057-808a-bb7c44f285d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:24.182728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-ffe90e17-fc87-41b8-892a-f75c881a6bbe None None] MFA Rules not processed for user `f3f46b66092d4bc8956f979530a04ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:24.183798 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1111/2185] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:24 2021] DELETE /identity/v3/projects/5945d5b705e445f59d0d6593ef9514fa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:24.183954 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ffe90e17-fc87-41b8-892a-f75c881a6bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:24.189138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587c17b-1803-4506-89fb-bf7bc2060270 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.189547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587c17b-1803-4506-89fb-bf7bc2060270 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.189933 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587c17b-1803-4506-89fb-bf7bc2060270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.210580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-1587c17b-1803-4506-89fb-bf7bc2060270 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:24.211990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1587c17b-1803-4506-89fb-bf7bc2060270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:24.259358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1075/2186] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:24 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:24.303381 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1112/2187] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:24.304731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a5677-ad53-4a96-836a-784feee7e317 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.305006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a5677-ad53-4a96-836a-784feee7e317 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.305287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a5677-ad53-4a96-836a-784feee7e317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.325905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b47a5677-ad53-4a96-836a-784feee7e317 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:24.327382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b47a5677-ad53-4a96-836a-784feee7e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:24.339883 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1076/2188] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:24.340741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587c17b-1803-4506-89fb-bf7bc2060270 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:24.351520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587c17b-1803-4506-89fb-bf7bc2060270 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:24.356167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e279dba-20d3-4b31-89e9-bb783c4195e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:24.356830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e279dba-20d3-4b31-89e9-bb783c4195e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.357117 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e279dba-20d3-4b31-89e9-bb783c4195e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.357397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e279dba-20d3-4b31-89e9-bb783c4195e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.358114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e279dba-20d3-4b31-89e9-bb783c4195e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:24.358423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e279dba-20d3-4b31-89e9-bb783c4195e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:24.360052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e279dba-20d3-4b31-89e9-bb783c4195e1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:24.375396 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1113/2189] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:28:24.378225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a5677-ad53-4a96-836a-784feee7e317 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:24.386701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a5677-ad53-4a96-836a-784feee7e317 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:24.391701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206c8a-0f34-4c1f-bdb9-aacffc45e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:24.392385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206c8a-0f34-4c1f-bdb9-aacffc45e2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.392666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206c8a-0f34-4c1f-bdb9-aacffc45e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.392939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206c8a-0f34-4c1f-bdb9-aacffc45e2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.393622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5206c8a-0f34-4c1f-bdb9-aacffc45e2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:24.395654 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5206c8a-0f34-4c1f-bdb9-aacffc45e2e7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:24.423825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1077/2190] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:24 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:24.425320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e279dba-20d3-4b31-89e9-bb783c4195e1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:24.436097 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e279dba-20d3-4b31-89e9-bb783c4195e1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:24.495097 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f4153-1554-4736-a2cc-4981cad6d8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:24.495868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f4153-1554-4736-a2cc-4981cad6d8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.496225 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f4153-1554-4736-a2cc-4981cad6d8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.496561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f4153-1554-4736-a2cc-4981cad6d8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.497306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f4153-1554-4736-a2cc-4981cad6d8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:24.499334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f4153-1554-4736-a2cc-4981cad6d8e9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:24.528715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1114/2191] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:24 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:28:24.532787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206c8a-0f34-4c1f-bdb9-aacffc45e2e7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:24.543465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206c8a-0f34-4c1f-bdb9-aacffc45e2e7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:24.548034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415f35e-40f3-4fda-9b2b-4c463f2df9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:24.548681 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415f35e-40f3-4fda-9b2b-4c463f2df9ec admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.548961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415f35e-40f3-4fda-9b2b-4c463f2df9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.549236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415f35e-40f3-4fda-9b2b-4c463f2df9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.549956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415f35e-40f3-4fda-9b2b-4c463f2df9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:24.551627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415f35e-40f3-4fda-9b2b-4c463f2df9ec admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:24.563381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1078/2192] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:24.567320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f4153-1554-4736-a2cc-4981cad6d8e9 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:24.577851 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f4153-1554-4736-a2cc-4981cad6d8e9 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:24.583231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eed9a8-e192-4f48-aa5a-a021cfc2c977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:24.583904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eed9a8-e192-4f48-aa5a-a021cfc2c977 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.584229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eed9a8-e192-4f48-aa5a-a021cfc2c977 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.584431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eed9a8-e192-4f48-aa5a-a021cfc2c977 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.585157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eed9a8-e192-4f48-aa5a-a021cfc2c977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:24.586776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eed9a8-e192-4f48-aa5a-a021cfc2c977 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:24.600102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1115/2193] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:24 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:24.604283 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415f35e-40f3-4fda-9b2b-4c463f2df9ec admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:24.614768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415f35e-40f3-4fda-9b2b-4c463f2df9ec admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:24.619880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc62e-b371-4499-97b7-87cb7bcd559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:24.620893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc62e-b371-4499-97b7-87cb7bcd559f admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.621289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc62e-b371-4499-97b7-87cb7bcd559f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.621600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc62e-b371-4499-97b7-87cb7bcd559f admin admin] PATH_INFO: `/v3/projects/22836adea60745a6ac0935abaeb72bb7/users/c6ca7007d3244e5cb4bce9e552186631/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.641127 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037dc62e-b371-4499-97b7-87cb7bcd559f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22836adea60745a6ac0935abaeb72bb7, user_id=c6ca7007d3244e5cb4bce9e552186631, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:24.643905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037dc62e-b371-4499-97b7-87cb7bcd559f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:24.662357 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1079/2194] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:24 2021] PUT /identity/v3/projects/22836adea60745a6ac0935abaeb72bb7/users/c6ca7007d3244e5cb4bce9e552186631/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:24.672848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c06f95-75f6-48e7-a944-0a496a0e7692 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.673346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c06f95-75f6-48e7-a944-0a496a0e7692 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.674917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c06f95-75f6-48e7-a944-0a496a0e7692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.711025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-f3c06f95-75f6-48e7-a944-0a496a0e7692 None None] MFA Rules not processed for user `c6ca7007d3244e5cb4bce9e552186631`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:24.712244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f3c06f95-75f6-48e7-a944-0a496a0e7692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:24.797156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1116/2195] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:24 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:24.803929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc62e-b371-4499-97b7-87cb7bcd559f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:24.806075 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-037dc62e-b371-4499-97b7-87cb7bcd559f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:24.889876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc62e-b371-4499-97b7-87cb7bcd559f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:24.893688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b866a-aa9a-4cd7-98df-4d5dcf145a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:24.894936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b866a-aa9a-4cd7-98df-4d5dcf145a1a service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:24.895226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b866a-aa9a-4cd7-98df-4d5dcf145a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:24.895740 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b866a-aa9a-4cd7-98df-4d5dcf145a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:24.904726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b866a-aa9a-4cd7-98df-4d5dcf145a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:24.906163 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b866a-aa9a-4cd7-98df-4d5dcf145a1a service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:24.915934 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1080/2196] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:24 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:33.283454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c06f95-75f6-48e7-a944-0a496a0e7692 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:33.285654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f3c06f95-75f6-48e7-a944-0a496a0e7692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:33.365305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c06f95-75f6-48e7-a944-0a496a0e7692 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:33.369989 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:33.374991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:33.375478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:33.375925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] PATH_INFO: `/v3/users/5e912fb508f2435891aee360dba73b6a` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:33.377436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e912fb508f2435891aee360dba73b6a)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:33.379828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:33.437052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e912fb508f2435891aee360dba73b6a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:33.451736 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e912fb508f2435891aee360dba73b6a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:33.452306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e912fb508f2435891aee360dba73b6a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:33.460395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e912fb508f2435891aee360dba73b6a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:33.461092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e912fb508f2435891aee360dba73b6a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:33.478717 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1117/2197] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:33 2021] DELETE /identity/v3/users/5e912fb508f2435891aee360dba73b6a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:33.481053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0af6-0f61-4bbf-8c29-c727437dcb4e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:33.481542 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0af6-0f61-4bbf-8c29-c727437dcb4e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:33.481645 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0af6-0f61-4bbf-8c29-c727437dcb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:33.499242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c7ae0af6-0f61-4bbf-8c29-c727437dcb4e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:33.500540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c7ae0af6-0f61-4bbf-8c29-c727437dcb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:33.562133 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1081/2198] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:33.572123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:33.573510 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:33.628278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea53ca-fb99-4bb0-a6d8-378f470bcee1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:33.631948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef23de-ee6f-4743-94e3-54a5761834b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:33.632591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef23de-ee6f-4743-94e3-54a5761834b8 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:33.632878 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef23de-ee6f-4743-94e3-54a5761834b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:33.633154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef23de-ee6f-4743-94e3-54a5761834b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:33.642363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef23de-ee6f-4743-94e3-54a5761834b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:33.643824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef23de-ee6f-4743-94e3-54a5761834b8 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:33.653527 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1118/2199] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:33.927693 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae0af6-0f61-4bbf-8c29-c727437dcb4e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:33.929100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c7ae0af6-0f61-4bbf-8c29-c727437dcb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:33.941522 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae0af6-0f61-4bbf-8c29-c727437dcb4e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:33.946027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:33.946910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:33.947190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:33.947467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] PATH_INFO: `/v3/projects/56ceddf8baf747f28b7b431573982677` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:33.948664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ceddf8baf747f28b7b431573982677)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:33.950574 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:33.994546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ceddf8baf747f28b7b431573982677', 'request_id': 'req-9683e98c-384d-46e6-8e1a-628858a30c81'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:34.000550 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ceddf8baf747f28b7b431573982677', 'request_id': 'req-9683e98c-384d-46e6-8e1a-628858a30c81'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:34.006756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ceddf8baf747f28b7b431573982677', 'request_id': 'req-9683e98c-384d-46e6-8e1a-628858a30c81'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:34.018454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] The token cache is being invalidate because project 56ceddf8baf747f28b7b431573982677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:34.018776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:34.020044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9683e98c-384d-46e6-8e1a-628858a30c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:34.021547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1082/2200] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:33 2021] DELETE /identity/v3/projects/56ceddf8baf747f28b7b431573982677 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:34.027327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec36675-ecad-4650-98a9-3ab5592720c5 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:34.027623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec36675-ecad-4650-98a9-3ab5592720c5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:34.027906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec36675-ecad-4650-98a9-3ab5592720c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:34.046884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-cec36675-ecad-4650-98a9-3ab5592720c5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:34.048087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cec36675-ecad-4650-98a9-3ab5592720c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:34.106423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1119/2201] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:34.114531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33059c71-0c78-43fc-84d6-aed1a0ac04d1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:34.114940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33059c71-0c78-43fc-84d6-aed1a0ac04d1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:34.115220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33059c71-0c78-43fc-84d6-aed1a0ac04d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:34.133408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-33059c71-0c78-43fc-84d6-aed1a0ac04d1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:34.134606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-33059c71-0c78-43fc-84d6-aed1a0ac04d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:34.142770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1083/2202] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:34.148516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec36675-ecad-4650-98a9-3ab5592720c5 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:34.158587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec36675-ecad-4650-98a9-3ab5592720c5 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:34.163182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691ce6-af1d-496d-ba15-4c94671d0679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:34.163837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691ce6-af1d-496d-ba15-4c94671d0679 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:34.164120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691ce6-af1d-496d-ba15-4c94671d0679 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:34.164401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691ce6-af1d-496d-ba15-4c94671d0679 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:34.165115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae691ce6-af1d-496d-ba15-4c94671d0679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:34.165422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae691ce6-af1d-496d-ba15-4c94671d0679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:34.167036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae691ce6-af1d-496d-ba15-4c94671d0679 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:34.179176 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1120/2203] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:28:34.183506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33059c71-0c78-43fc-84d6-aed1a0ac04d1 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:34.193408 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33059c71-0c78-43fc-84d6-aed1a0ac04d1 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:34.198162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b97878-0cac-4a62-a789-fc411db5b083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:34.199072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b97878-0cac-4a62-a789-fc411db5b083 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:34.199325 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b97878-0cac-4a62-a789-fc411db5b083 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:34.199672 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b97878-0cac-4a62-a789-fc411db5b083 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:34.200427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b97878-0cac-4a62-a789-fc411db5b083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:34.202374 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b97878-0cac-4a62-a789-fc411db5b083 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:34.227536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1084/2204] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:34 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:34.231614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691ce6-af1d-496d-ba15-4c94671d0679 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:34.241891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691ce6-af1d-496d-ba15-4c94671d0679 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:34.296164 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aba86-0e09-445c-9141-7efa1edd374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:34.296859 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aba86-0e09-445c-9141-7efa1edd374b admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:34.297141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aba86-0e09-445c-9141-7efa1edd374b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:34.297418 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aba86-0e09-445c-9141-7efa1edd374b admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:34.298095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4aba86-0e09-445c-9141-7efa1edd374b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:34.300031 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4aba86-0e09-445c-9141-7efa1edd374b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:34.321160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1121/2205] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:34 2021] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:34.325227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b97878-0cac-4a62-a789-fc411db5b083 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:34.335957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b97878-0cac-4a62-a789-fc411db5b083 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:34.340942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202c68b-a7e6-4422-97fe-840dc5f4c016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:34.341601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c68b-a7e6-4422-97fe-840dc5f4c016 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:34.341882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c68b-a7e6-4422-97fe-840dc5f4c016 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:34.342157 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c68b-a7e6-4422-97fe-840dc5f4c016 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:34.342976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202c68b-a7e6-4422-97fe-840dc5f4c016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:34.344598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202c68b-a7e6-4422-97fe-840dc5f4c016 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:34.354918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1085/2206] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:34.358908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aba86-0e09-445c-9141-7efa1edd374b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:34.369402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aba86-0e09-445c-9141-7efa1edd374b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:34.374170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3bf85-f61c-4d10-a483-7184fad7bfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:34.374867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3bf85-f61c-4d10-a483-7184fad7bfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:34.375152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3bf85-f61c-4d10-a483-7184fad7bfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:34.375429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3bf85-f61c-4d10-a483-7184fad7bfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:34.376151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3bf85-f61c-4d10-a483-7184fad7bfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:34.377777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3bf85-f61c-4d10-a483-7184fad7bfb8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:34.388200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1122/2207] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:34.392497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202c68b-a7e6-4422-97fe-840dc5f4c016 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:34.402430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202c68b-a7e6-4422-97fe-840dc5f4c016 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:34.407088 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b1693-a501-4687-8927-bb1bac664bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:34.407958 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b1693-a501-4687-8927-bb1bac664bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:34.408243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b1693-a501-4687-8927-bb1bac664bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:34.408518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b1693-a501-4687-8927-bb1bac664bb9 admin admin] PATH_INFO: `/v3/projects/cdf67756f57948e9a1bcaae4578b8fb6/users/31c9651dc204465eb9038c903a08910f/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:34.425874 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b1693-a501-4687-8927-bb1bac664bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf67756f57948e9a1bcaae4578b8fb6, user_id=31c9651dc204465eb9038c903a08910f, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:34.429338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b1693-a501-4687-8927-bb1bac664bb9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:34.449562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1086/2208] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:34 2021] PUT /identity/v3/projects/cdf67756f57948e9a1bcaae4578b8fb6/users/31c9651dc204465eb9038c903a08910f/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:34.454473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcb91f-c142-49a7-ad94-f781daaae17d None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:34.454795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcb91f-c142-49a7-ad94-f781daaae17d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:34.455079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcb91f-c142-49a7-ad94-f781daaae17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:34.472419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-c0dcb91f-c142-49a7-ad94-f781daaae17d None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:34.473628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-c0dcb91f-c142-49a7-ad94-f781daaae17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:34.536651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1123/2209] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:34.545965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b1693-a501-4687-8927-bb1bac664bb9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:34.547714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8e0b1693-a501-4687-8927-bb1bac664bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:34.602478 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b1693-a501-4687-8927-bb1bac664bb9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:34.606099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde74db-6cad-4966-b52b-d38673cf3efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:34.606776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde74db-6cad-4966-b52b-d38673cf3efb service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:34.607062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde74db-6cad-4966-b52b-d38673cf3efb service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:34.607339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde74db-6cad-4966-b52b-d38673cf3efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:34.616812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde74db-6cad-4966-b52b-d38673cf3efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:34.618230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde74db-6cad-4966-b52b-d38673cf3efb service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:34.627314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1087/2210] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:28:39.688677 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8861-7519-44fc-b628-bccc4c74ac7c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:39.689148 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8861-7519-44fc-b628-bccc4c74ac7c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:39.689257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8861-7519-44fc-b628-bccc4c74ac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:39.714853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e64a8861-7519-44fc-b628-bccc4c74ac7c None None] MFA Rules not processed for user `31c9651dc204465eb9038c903a08910f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:39.716007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e64a8861-7519-44fc-b628-bccc4c74ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:39.779782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1124/2211] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:39 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:39.785352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde74db-6cad-4966-b52b-d38673cf3efb service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:39.795390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde74db-6cad-4966-b52b-d38673cf3efb service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:39.800308 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686a642-108a-473c-8014-908058aa3984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:39.800955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686a642-108a-473c-8014-908058aa3984 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:39.801241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686a642-108a-473c-8014-908058aa3984 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:39.801517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686a642-108a-473c-8014-908058aa3984 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:39.802214 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686a642-108a-473c-8014-908058aa3984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:39.804142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686a642-108a-473c-8014-908058aa3984 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:39.830726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1088/2212] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:39 2021] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:39.835508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a8861-7519-44fc-b628-bccc4c74ac7c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:39.846052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a8861-7519-44fc-b628-bccc4c74ac7c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:39.902321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab9f27-5b4b-4222-a3f1-9d562a26618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:39.903050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab9f27-5b4b-4222-a3f1-9d562a26618c admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:39.903337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab9f27-5b4b-4222-a3f1-9d562a26618c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:39.903621 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab9f27-5b4b-4222-a3f1-9d562a26618c admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:39.904316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab9f27-5b4b-4222-a3f1-9d562a26618c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:39.906246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab9f27-5b4b-4222-a3f1-9d562a26618c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:39.926074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1125/2213] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:39 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:39.930257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686a642-108a-473c-8014-908058aa3984 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:39.941621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686a642-108a-473c-8014-908058aa3984 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:39.947130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bc61e-fa63-4706-be8d-6e75cbeeb580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:39.947794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bc61e-fa63-4706-be8d-6e75cbeeb580 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:39.948112 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bc61e-fa63-4706-be8d-6e75cbeeb580 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:39.948398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bc61e-fa63-4706-be8d-6e75cbeeb580 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:39.949131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bc61e-fa63-4706-be8d-6e75cbeeb580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:39.950817 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bc61e-fa63-4706-be8d-6e75cbeeb580 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:39.962309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1089/2214] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:39 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:39.966502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab9f27-5b4b-4222-a3f1-9d562a26618c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:39.976317 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab9f27-5b4b-4222-a3f1-9d562a26618c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:39.982580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8b372-25b6-4f1e-ab9b-9208de97e725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:39.983808 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8b372-25b6-4f1e-ab9b-9208de97e725 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:39.984140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8b372-25b6-4f1e-ab9b-9208de97e725 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:39.984545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8b372-25b6-4f1e-ab9b-9208de97e725 admin admin] PATH_INFO: `/v3/projects/86c670a5acab4a2cbcfbb3296c0e4488/users/f01410474c294d1397821af0d866f560/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:40.000292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8b372-25b6-4f1e-ab9b-9208de97e725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c670a5acab4a2cbcfbb3296c0e4488, user_id=f01410474c294d1397821af0d866f560, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:40.003716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8b372-25b6-4f1e-ab9b-9208de97e725 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:40.019399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1126/2215] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:39 2021] PUT /identity/v3/projects/86c670a5acab4a2cbcfbb3296c0e4488/users/f01410474c294d1397821af0d866f560/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:40.023537 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bc61e-fa63-4706-be8d-6e75cbeeb580 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:40.032783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bc61e-fa63-4706-be8d-6e75cbeeb580 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:40.091139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec8aab-394b-4654-842c-6456167a852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:40.091814 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec8aab-394b-4654-842c-6456167a852a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:40.092104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec8aab-394b-4654-842c-6456167a852a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:40.092386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec8aab-394b-4654-842c-6456167a852a admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:40.093114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec8aab-394b-4654-842c-6456167a852a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:40.094713 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec8aab-394b-4654-842c-6456167a852a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:40.104503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1090/2216] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:40 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:40.108582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8b372-25b6-4f1e-ab9b-9208de97e725 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:40.118532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8b372-25b6-4f1e-ab9b-9208de97e725 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:40.123191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e8bc9-1093-4e09-8bee-4febfb47bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:40.124070 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8bc9-1093-4e09-8bee-4febfb47bc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:40.124355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8bc9-1093-4e09-8bee-4febfb47bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:40.124632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8bc9-1093-4e09-8bee-4febfb47bc5b admin admin] PATH_INFO: `/v3/projects/86c670a5acab4a2cbcfbb3296c0e4488/users/f01410474c294d1397821af0d866f560/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:40.126592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e8bc9-1093-4e09-8bee-4febfb47bc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c670a5acab4a2cbcfbb3296c0e4488, user_id=f01410474c294d1397821af0d866f560, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:40.129895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e8bc9-1093-4e09-8bee-4febfb47bc5b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:40.140620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1127/2217] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:40 2021] PUT /identity/v3/projects/86c670a5acab4a2cbcfbb3296c0e4488/users/f01410474c294d1397821af0d866f560/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:45.048132 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec8aab-394b-4654-842c-6456167a852a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:45.051065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0eec8aab-394b-4654-842c-6456167a852a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:45.068847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec8aab-394b-4654-842c-6456167a852a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:45.171103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:45.175764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:45.175936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:45.176212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] PATH_INFO: `/v3/users/2ae0024c482d48f48711c04d8a6693dc` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:45.179231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae0024c482d48f48711c04d8a6693dc)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:45.183698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:45.326606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae0024c482d48f48711c04d8a6693dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:45.342308 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae0024c482d48f48711c04d8a6693dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:45.343268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae0024c482d48f48711c04d8a6693dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:45.344082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae0024c482d48f48711c04d8a6693dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:45.362067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae0024c482d48f48711c04d8a6693dc'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:45.399813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1091/2218] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:45 2021] DELETE /identity/v3/users/2ae0024c482d48f48711c04d8a6693dc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:45.404634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd323b2b-863e-41fd-9f25-c84a59ca0c1c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:45.405740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd323b2b-863e-41fd-9f25-c84a59ca0c1c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:45.405740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd323b2b-863e-41fd-9f25-c84a59ca0c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:45.454658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-bd323b2b-863e-41fd-9f25-c84a59ca0c1c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:45.455934 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-bd323b2b-863e-41fd-9f25-c84a59ca0c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:45.649333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1128/2219] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:45.665651 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:45.667198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:45.810177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8924c2-3194-4694-9da8-43f15c7fdf7b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:45.814872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed878fd-9062-4ee6-8bb9-f9233636658e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:45.816228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed878fd-9062-4ee6-8bb9-f9233636658e service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:45.816510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed878fd-9062-4ee6-8bb9-f9233636658e service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:45.816786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed878fd-9062-4ee6-8bb9-f9233636658e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:45.855416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed878fd-9062-4ee6-8bb9-f9233636658e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:45.857779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed878fd-9062-4ee6-8bb9-f9233636658e service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:45.887266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1092/2220] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:46.009145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd4383-e9cf-442c-a24d-6eca515f1ae6 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:46.009433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd4383-e9cf-442c-a24d-6eca515f1ae6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:46.009928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd4383-e9cf-442c-a24d-6eca515f1ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:46.078943 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-14cd4383-e9cf-442c-a24d-6eca515f1ae6 None None] MFA Rules not processed for user `f01410474c294d1397821af0d866f560`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:46.080681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-14cd4383-e9cf-442c-a24d-6eca515f1ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:46.320329 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1129/2221] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:46 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:46.322209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed878fd-9062-4ee6-8bb9-f9233636658e service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:46.324616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5ed878fd-9062-4ee6-8bb9-f9233636658e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:46.472873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd4383-e9cf-442c-a24d-6eca515f1ae6 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:46.474892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-14cd4383-e9cf-442c-a24d-6eca515f1ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:46.493342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed878fd-9062-4ee6-8bb9-f9233636658e service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:46.499006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd4383-e9cf-442c-a24d-6eca515f1ae6 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:46.505749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:46.506965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:46.507487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:46.507975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] PATH_INFO: `/v3/projects/ee3d44ad29e149f88a76713b8909e34f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:46.509468 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3d44ad29e149f88a76713b8909e34f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:46.511834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:46.514615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b2c30-0e7b-4a37-8190-92af74ac4acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:46.515682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b2c30-0e7b-4a37-8190-92af74ac4acf service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:46.516284 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b2c30-0e7b-4a37-8190-92af74ac4acf service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:46.517167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b2c30-0e7b-4a37-8190-92af74ac4acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:46.519344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-135b2c30-0e7b-4a37-8190-92af74ac4acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:46.573951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3d44ad29e149f88a76713b8909e34f', 'request_id': 'req-b909f96d-434a-4de1-ae38-bea5b7921797'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:46.583855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3d44ad29e149f88a76713b8909e34f', 'request_id': 'req-b909f96d-434a-4de1-ae38-bea5b7921797'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:46.601300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3d44ad29e149f88a76713b8909e34f', 'request_id': 'req-b909f96d-434a-4de1-ae38-bea5b7921797'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:46.611816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b2c30-0e7b-4a37-8190-92af74ac4acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:46.614358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b2c30-0e7b-4a37-8190-92af74ac4acf service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:46.628387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1093/2222] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:46 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:46.641900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] The token cache is being invalidate because project ee3d44ad29e149f88a76713b8909e34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:28:46.644471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:46.645845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b909f96d-434a-4de1-ae38-bea5b7921797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:46.657387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc134c3a-ef5b-4d50-89c5-3817064283c1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:46.657683 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc134c3a-ef5b-4d50-89c5-3817064283c1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:46.658009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc134c3a-ef5b-4d50-89c5-3817064283c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:46.664671 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1130/2223] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:28:46 2021] DELETE /identity/v3/projects/ee3d44ad29e149f88a76713b8909e34f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:46.694851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-fc134c3a-ef5b-4d50-89c5-3817064283c1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:46.696063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-fc134c3a-ef5b-4d50-89c5-3817064283c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:46.845743 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1094/2224] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:46.849618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead59f4-8caf-40b9-9a0b-0ad000cab328 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:46.849909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead59f4-8caf-40b9-9a0b-0ad000cab328 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:46.850187 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead59f4-8caf-40b9-9a0b-0ad000cab328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:46.885651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-eead59f4-8caf-40b9-9a0b-0ad000cab328 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:46.887881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-eead59f4-8caf-40b9-9a0b-0ad000cab328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:46.919983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1131/2225] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:46.920444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc134c3a-ef5b-4d50-89c5-3817064283c1 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:46.951179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc134c3a-ef5b-4d50-89c5-3817064283c1 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:46.966755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb770d-05c5-422f-9a85-72c3edf76398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:46.967620 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb770d-05c5-422f-9a85-72c3edf76398 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:46.967863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb770d-05c5-422f-9a85-72c3edf76398 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:46.968139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb770d-05c5-422f-9a85-72c3edf76398 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:46.968878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb770d-05c5-422f-9a85-72c3edf76398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:28:46.969187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb770d-05c5-422f-9a85-72c3edf76398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:46.970833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb770d-05c5-422f-9a85-72c3edf76398 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:46.998309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1095/2226] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:28:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:28:47.003868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead59f4-8caf-40b9-9a0b-0ad000cab328 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:47.028823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead59f4-8caf-40b9-9a0b-0ad000cab328 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:47.037573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf8433-f495-4829-a5de-4ad049897237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:47.038394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8433-f495-4829-a5de-4ad049897237 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:47.038785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8433-f495-4829-a5de-4ad049897237 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:47.039181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8433-f495-4829-a5de-4ad049897237 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:47.040244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf8433-f495-4829-a5de-4ad049897237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:47.042730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf8433-f495-4829-a5de-4ad049897237 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:47.077167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1132/2227] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:28:47 2021] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:47.083646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb770d-05c5-422f-9a85-72c3edf76398 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:47.100704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb770d-05c5-422f-9a85-72c3edf76398 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:47.181962 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde365d3-7cd8-4997-89f4-fb60d988232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:47.182804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde365d3-7cd8-4997-89f4-fb60d988232f admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:47.183016 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde365d3-7cd8-4997-89f4-fb60d988232f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:47.183249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde365d3-7cd8-4997-89f4-fb60d988232f admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:47.184093 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde365d3-7cd8-4997-89f4-fb60d988232f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:47.187624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde365d3-7cd8-4997-89f4-fb60d988232f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:47.210300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1096/2228] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:28:47 2021] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:28:47.214811 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf8433-f495-4829-a5de-4ad049897237 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:47.227802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf8433-f495-4829-a5de-4ad049897237 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:47.233086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22695fa-653e-4cf4-a8ba-936d44fbb242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:47.233756 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22695fa-653e-4cf4-a8ba-936d44fbb242 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:47.234394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22695fa-653e-4cf4-a8ba-936d44fbb242 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:47.235064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22695fa-653e-4cf4-a8ba-936d44fbb242 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:47.236416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22695fa-653e-4cf4-a8ba-936d44fbb242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:47.238782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22695fa-653e-4cf4-a8ba-936d44fbb242 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:47.261324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1133/2229] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:47 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:28:47.265507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde365d3-7cd8-4997-89f4-fb60d988232f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:47.288797 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde365d3-7cd8-4997-89f4-fb60d988232f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:47.295973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f48d88-2eae-470a-9d72-004883216825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:47.297169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48d88-2eae-470a-9d72-004883216825 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:47.297777 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48d88-2eae-470a-9d72-004883216825 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:47.298234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48d88-2eae-470a-9d72-004883216825 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:47.299193 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f48d88-2eae-470a-9d72-004883216825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:47.302227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f48d88-2eae-470a-9d72-004883216825 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:47.319138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1097/2230] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:28:47 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:28:47.323863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22695fa-653e-4cf4-a8ba-936d44fbb242 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:47.358116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22695fa-653e-4cf4-a8ba-936d44fbb242 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:47.383188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd85ce8-943f-4e9f-b424-a338158097f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:47.384032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd85ce8-943f-4e9f-b424-a338158097f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:47.384480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd85ce8-943f-4e9f-b424-a338158097f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:47.384947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd85ce8-943f-4e9f-b424-a338158097f1 admin admin] PATH_INFO: `/v3/projects/31f1aac16d6d44079483398dc5cd0355/users/98f1e16f64334033959655f66c3caa9b/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:47.406078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd85ce8-943f-4e9f-b424-a338158097f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f1aac16d6d44079483398dc5cd0355, user_id=98f1e16f64334033959655f66c3caa9b, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:47.410453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd85ce8-943f-4e9f-b424-a338158097f1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:47.437676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1134/2231] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:28:47 2021] PUT /identity/v3/projects/31f1aac16d6d44079483398dc5cd0355/users/98f1e16f64334033959655f66c3caa9b/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:28:47.447689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f81f4-6b7d-4beb-a0c7-e284d899e591 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:47.448257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f81f4-6b7d-4beb-a0c7-e284d899e591 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:47.448257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f81f4-6b7d-4beb-a0c7-e284d899e591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:47.479977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-844f81f4-6b7d-4beb-a0c7-e284d899e591 None None] MFA Rules not processed for user `98f1e16f64334033959655f66c3caa9b`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:47.481433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-844f81f4-6b7d-4beb-a0c7-e284d899e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:47.570258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1098/2232] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:47 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:47.590431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd85ce8-943f-4e9f-b424-a338158097f1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:47.592710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fcd85ce8-943f-4e9f-b424-a338158097f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:47.680723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd85ce8-943f-4e9f-b424-a338158097f1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:47.684641 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d99452-91b6-4cd9-84b3-e551e86baed1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b9d35e26e64c959e075622321df3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:47.685281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d99452-91b6-4cd9-84b3-e551e86baed1 service glance] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:47.685570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d99452-91b6-4cd9-84b3-e551e86baed1 service glance] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:47.685848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d99452-91b6-4cd9-84b3-e551e86baed1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:47.695197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d99452-91b6-4cd9-84b3-e551e86baed1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:47.696716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d99452-91b6-4cd9-84b3-e551e86baed1 service glance] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:47.707378 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1135/2233] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:47 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:28:48.867889 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46b3d-1234-458f-973b-b95aeb7451c8 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:48.868358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46b3d-1234-458f-973b-b95aeb7451c8 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:48.868358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46b3d-1234-458f-973b-b95aeb7451c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:48.898266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c3a46b3d-1234-458f-973b-b95aeb7451c8 None None] MFA Rules not processed for user `31c9651dc204465eb9038c903a08910f`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:48.899746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c3a46b3d-1234-458f-973b-b95aeb7451c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:48.980989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1099/2234] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:48 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:28:59.753200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d99452-91b6-4cd9-84b3-e551e86baed1 service glance] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:59.755419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a9d99452-91b6-4cd9-84b3-e551e86baed1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:59.817467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d99452-91b6-4cd9-84b3-e551e86baed1 service glance] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:28:59.822084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:28:59.822942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:59.823226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:59.823644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] PATH_INFO: `/v3/users/c6ca7007d3244e5cb4bce9e552186631` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:59.824827 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ca7007d3244e5cb4bce9e552186631)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:28:59.826972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:28:59.870821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ca7007d3244e5cb4bce9e552186631'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:59.882487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ca7007d3244e5cb4bce9e552186631'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:59.883181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ca7007d3244e5cb4bce9e552186631'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:59.889979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ca7007d3244e5cb4bce9e552186631'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:59.890671 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ca7007d3244e5cb4bce9e552186631'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:28:59.903470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1136/2235] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:28:59 2021] DELETE /identity/v3/users/c6ca7007d3244e5cb4bce9e552186631 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:28:59.908049 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e40af9-6399-4f3d-9830-b49604cbbb67 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:28:59.908568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e40af9-6399-4f3d-9830-b49604cbbb67 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:28:59.908691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e40af9-6399-4f3d-9830-b49604cbbb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:28:59.925686 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b1e40af9-6399-4f3d-9830-b49604cbbb67 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:28:59.927507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b1e40af9-6399-4f3d-9830-b49604cbbb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:28:59.987046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1100/2236] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:28:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:28:59.997645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:28:59.999055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:00.055729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df8820-0011-482d-a5e4-3eed9ffa3ad4 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:00.060047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2da4-dbae-45f2-a39e-53487fe80d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:00.060738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2da4-dbae-45f2-a39e-53487fe80d47 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:00.061022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2da4-dbae-45f2-a39e-53487fe80d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:00.061386 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2da4-dbae-45f2-a39e-53487fe80d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:00.071460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e2da4-dbae-45f2-a39e-53487fe80d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:00.073778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e2da4-dbae-45f2-a39e-53487fe80d47 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:00.083850 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1137/2237] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:28:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:29:00.379557 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e40af9-6399-4f3d-9830-b49604cbbb67 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:00.381084 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b1e40af9-6399-4f3d-9830-b49604cbbb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:00.395780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e40af9-6399-4f3d-9830-b49604cbbb67 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:00.402301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:00.403455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:00.403860 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:00.404169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] PATH_INFO: `/v3/projects/22836adea60745a6ac0935abaeb72bb7` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:00.405901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22836adea60745a6ac0935abaeb72bb7)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:00.414573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:00.491898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22836adea60745a6ac0935abaeb72bb7', 'request_id': 'req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:00.498406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22836adea60745a6ac0935abaeb72bb7', 'request_id': 'req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:00.503841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22836adea60745a6ac0935abaeb72bb7', 'request_id': 'req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:00.519213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] The token cache is being invalidate because project 22836adea60745a6ac0935abaeb72bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:29:00.520162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:00.521251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ec181f2d-1dbb-4803-b2a6-64c8ca24c806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:00.530876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1101/2238] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:29:00 2021] DELETE /identity/v3/projects/22836adea60745a6ac0935abaeb72bb7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:29:01.748954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2da4-dbae-45f2-a39e-53487fe80d47 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:01.751255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f75e2da4-dbae-45f2-a39e-53487fe80d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:01.765579 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2da4-dbae-45f2-a39e-53487fe80d47 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:01.837821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:01.839502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:01.839896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:01.840387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] PATH_INFO: `/v3/users/1f7499884b7d47b196ed870e139cd2c3` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:01.841485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7499884b7d47b196ed870e139cd2c3)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:01.848959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:01.895481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7499884b7d47b196ed870e139cd2c3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:01.906600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7499884b7d47b196ed870e139cd2c3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:01.907280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7499884b7d47b196ed870e139cd2c3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:01.914489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7499884b7d47b196ed870e139cd2c3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:01.915144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7499884b7d47b196ed870e139cd2c3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:01.927534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1138/2239] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:29:01 2021] DELETE /identity/v3/users/1f7499884b7d47b196ed870e139cd2c3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:29:01.932206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622bea-3910-4848-9c8d-75b7c22ca962 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:01.932697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622bea-3910-4848-9c8d-75b7c22ca962 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:01.932804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622bea-3910-4848-9c8d-75b7c22ca962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:01.949952 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-fe622bea-3910-4848-9c8d-75b7c22ca962 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:29:01.951216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-fe622bea-3910-4848-9c8d-75b7c22ca962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:02.010155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1102/2240] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:29:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:29:02.020449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:02.021967 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:02.076921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b54e85-0177-42a8-a8ef-508060e41f80 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:02.080568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9daac0-0145-4b93-b35f-5da6808c8e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:02.081212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9daac0-0145-4b93-b35f-5da6808c8e90 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.081539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9daac0-0145-4b93-b35f-5da6808c8e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.081819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9daac0-0145-4b93-b35f-5da6808c8e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.091165 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9daac0-0145-4b93-b35f-5da6808c8e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:02.092580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9daac0-0145-4b93-b35f-5da6808c8e90 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:02.102275 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1139/2241] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:29:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:29:02.371864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622bea-3910-4848-9c8d-75b7c22ca962 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:02.373363 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-fe622bea-3910-4848-9c8d-75b7c22ca962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:02.385689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622bea-3910-4848-9c8d-75b7c22ca962 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:02.390579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:02.391614 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.391899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.392174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] PATH_INFO: `/v3/projects/a7c8eae29e4c436d97eef86ef09220df` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.393331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c8eae29e4c436d97eef86ef09220df)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:02.396091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:02.439499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c8eae29e4c436d97eef86ef09220df', 'request_id': 'req-7b948e47-881b-4cd4-8a95-040d54a81afa'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:02.445949 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c8eae29e4c436d97eef86ef09220df', 'request_id': 'req-7b948e47-881b-4cd4-8a95-040d54a81afa'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:02.451218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c8eae29e4c436d97eef86ef09220df', 'request_id': 'req-7b948e47-881b-4cd4-8a95-040d54a81afa'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:02.463514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] The token cache is being invalidate because project a7c8eae29e4c436d97eef86ef09220df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:29:02.463800 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:02.464409 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7b948e47-881b-4cd4-8a95-040d54a81afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:02.465881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1103/2242] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:29:02 2021] DELETE /identity/v3/projects/a7c8eae29e4c436d97eef86ef09220df => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:29:02.471468 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6bf27-9e08-4a20-9c38-a0cc37d4f9a3 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.471757 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6bf27-9e08-4a20-9c38-a0cc37d4f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.472034 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6bf27-9e08-4a20-9c38-a0cc37d4f9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.490619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7bc6bf27-9e08-4a20-9c38-a0cc37d4f9a3 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:29:02.491877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7bc6bf27-9e08-4a20-9c38-a0cc37d4f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:02.552086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1140/2243] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:29:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:29:02.559915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcf9a8-c521-40b8-8a27-e66cbae3fc29 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.560196 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcf9a8-c521-40b8-8a27-e66cbae3fc29 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.560468 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcf9a8-c521-40b8-8a27-e66cbae3fc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.579072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-11bcf9a8-c521-40b8-8a27-e66cbae3fc29 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:29:02.580266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-11bcf9a8-c521-40b8-8a27-e66cbae3fc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:02.588704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1104/2244] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:29:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:29:02.592750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6bf27-9e08-4a20-9c38-a0cc37d4f9a3 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:02.602052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6bf27-9e08-4a20-9c38-a0cc37d4f9a3 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:02.606531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301adc2f-ac5c-4fda-84ec-be8b33db260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:02.607215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301adc2f-ac5c-4fda-84ec-be8b33db260d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.607500 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301adc2f-ac5c-4fda-84ec-be8b33db260d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.607777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301adc2f-ac5c-4fda-84ec-be8b33db260d admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.608488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301adc2f-ac5c-4fda-84ec-be8b33db260d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:29:02.608793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301adc2f-ac5c-4fda-84ec-be8b33db260d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:02.610368 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301adc2f-ac5c-4fda-84ec-be8b33db260d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:02.621893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1141/2245] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:29:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:29:02.625913 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcf9a8-c521-40b8-8a27-e66cbae3fc29 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:02.637586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcf9a8-c521-40b8-8a27-e66cbae3fc29 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:02.642547 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8abba-ff61-4adf-b0bd-a747e24209fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:02.643252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8abba-ff61-4adf-b0bd-a747e24209fb admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.643536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8abba-ff61-4adf-b0bd-a747e24209fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.643814 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8abba-ff61-4adf-b0bd-a747e24209fb admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.644518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8abba-ff61-4adf-b0bd-a747e24209fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:02.646481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8abba-ff61-4adf-b0bd-a747e24209fb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:02.680391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1105/2246] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:29:02 2021] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:29:02.684950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301adc2f-ac5c-4fda-84ec-be8b33db260d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:02.695930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301adc2f-ac5c-4fda-84ec-be8b33db260d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:02.748701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99e759-1b2d-4794-b498-7377c901940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:02.749382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99e759-1b2d-4794-b498-7377c901940d admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.749946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99e759-1b2d-4794-b498-7377c901940d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.749946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99e759-1b2d-4794-b498-7377c901940d admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.750644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99e759-1b2d-4794-b498-7377c901940d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:02.752592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99e759-1b2d-4794-b498-7377c901940d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:02.772710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1142/2247] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:29:02 2021] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:29:02.777075 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8abba-ff61-4adf-b0bd-a747e24209fb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:02.787120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8abba-ff61-4adf-b0bd-a747e24209fb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:02.791653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46c9a-e3fe-49a6-be31-9ac543cb7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:02.792286 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46c9a-e3fe-49a6-be31-9ac543cb7e2b admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.792567 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46c9a-e3fe-49a6-be31-9ac543cb7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.792844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46c9a-e3fe-49a6-be31-9ac543cb7e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.793596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46c9a-e3fe-49a6-be31-9ac543cb7e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:02.795465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46c9a-e3fe-49a6-be31-9ac543cb7e2b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:02.806643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1106/2248] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:29:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:29:02.810175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99e759-1b2d-4794-b498-7377c901940d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:02.820613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99e759-1b2d-4794-b498-7377c901940d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:02.825963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd2f33-e4b6-4243-9666-801858e65a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:02.826648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd2f33-e4b6-4243-9666-801858e65a91 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.826968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd2f33-e4b6-4243-9666-801858e65a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.827290 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd2f33-e4b6-4243-9666-801858e65a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.828199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd2f33-e4b6-4243-9666-801858e65a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:02.829821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd2f33-e4b6-4243-9666-801858e65a91 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:02.843278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1143/2249] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:29:02 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:29:02.847251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46c9a-e3fe-49a6-be31-9ac543cb7e2b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:02.856890 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46c9a-e3fe-49a6-be31-9ac543cb7e2b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:02.861539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafed02-99a1-4058-a97e-4d30e60f88b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:02.862405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafed02-99a1-4058-a97e-4d30e60f88b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.862702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafed02-99a1-4058-a97e-4d30e60f88b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.863010 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafed02-99a1-4058-a97e-4d30e60f88b0 admin admin] PATH_INFO: `/v3/projects/204febb2b66a4eaa9092d2074c9adabb/users/d13764d2b0af4d108c1064eb3754c73f/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.887070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafed02-99a1-4058-a97e-4d30e60f88b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=204febb2b66a4eaa9092d2074c9adabb, user_id=d13764d2b0af4d108c1064eb3754c73f, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:02.887070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafed02-99a1-4058-a97e-4d30e60f88b0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:02.913018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1107/2250] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:29:02 2021] PUT /identity/v3/projects/204febb2b66a4eaa9092d2074c9adabb/users/d13764d2b0af4d108c1064eb3754c73f/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:29:02.915452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb6d3f-0e3f-448e-a83f-60a89ec31835 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:02.915862 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb6d3f-0e3f-448e-a83f-60a89ec31835 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:02.916023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb6d3f-0e3f-448e-a83f-60a89ec31835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:02.950876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-5edb6d3f-0e3f-448e-a83f-60a89ec31835 None None] MFA Rules not processed for user `d13764d2b0af4d108c1064eb3754c73f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:29:02.952183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5edb6d3f-0e3f-448e-a83f-60a89ec31835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:03.023870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1144/2251] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:29:02 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:29:03.034580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafed02-99a1-4058-a97e-4d30e60f88b0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:03.037237 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1eafed02-99a1-4058-a97e-4d30e60f88b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:03.101023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafed02-99a1-4058-a97e-4d30e60f88b0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:03.104699 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42262bb9-221f-43bb-bdf9-56c7dba49108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:03.105341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42262bb9-221f-43bb-bdf9-56c7dba49108 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:03.105627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42262bb9-221f-43bb-bdf9-56c7dba49108 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:03.105907 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42262bb9-221f-43bb-bdf9-56c7dba49108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:03.115019 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42262bb9-221f-43bb-bdf9-56c7dba49108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:03.116620 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42262bb9-221f-43bb-bdf9-56c7dba49108 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:03.125489 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1108/2252] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:29:03 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:29:06.666589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549419c-e696-4176-9053-44cac0e6128b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:06.667125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549419c-e696-4176-9053-44cac0e6128b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:06.667458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549419c-e696-4176-9053-44cac0e6128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:06.685007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-8549419c-e696-4176-9053-44cac0e6128b None None] MFA Rules not processed for user `d2f7490ad6cf4bed96cfec8a39a65b43`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:29:06.686375 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8549419c-e696-4176-9053-44cac0e6128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:06.737279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1145/2253] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:29:06 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:29:25.620168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c36f9-4d3d-4b98-90f6-1dfdfba01e38 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:25.620715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c36f9-4d3d-4b98-90f6-1dfdfba01e38 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:25.620715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c36f9-4d3d-4b98-90f6-1dfdfba01e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:25.638382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d52c36f9-4d3d-4b98-90f6-1dfdfba01e38 None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:29:25.639896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d52c36f9-4d3d-4b98-90f6-1dfdfba01e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:25.712126 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1109/2254] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:29:25 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:29:25.767423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549419c-e696-4176-9053-44cac0e6128b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:25.769070 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8549419c-e696-4176-9053-44cac0e6128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:25.917787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549419c-e696-4176-9053-44cac0e6128b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:25.924028 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5214bdb-3b37-4638-948e-33a185d13c81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:25.925038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5214bdb-3b37-4638-948e-33a185d13c81 service swift] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:25.925512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5214bdb-3b37-4638-948e-33a185d13c81 service swift] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:25.925785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5214bdb-3b37-4638-948e-33a185d13c81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:25.937652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5214bdb-3b37-4638-948e-33a185d13c81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:25.939610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5214bdb-3b37-4638-948e-33a185d13c81 service swift] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:25.949805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1146/2255] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:29:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:29:56.100190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca880ad-b94a-433e-8418-ed1170e169a4 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:56.100717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca880ad-b94a-433e-8418-ed1170e169a4 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:56.100820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca880ad-b94a-433e-8418-ed1170e169a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:56.118234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-dca880ad-b94a-433e-8418-ed1170e169a4 None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:29:56.119492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-dca880ad-b94a-433e-8418-ed1170e169a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:56.126564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1110/2256] 10.222.0.23 () {58 vars in 968 bytes} [Wed Aug 25 01:29:56 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:29:56.139645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5214bdb-3b37-4638-948e-33a185d13c81 service swift] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:56.150440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5214bdb-3b37-4638-948e-33a185d13c81 service swift] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:56.155393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361f657-172c-4e14-8b3a-9966cd8810aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:56.156018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361f657-172c-4e14-8b3a-9966cd8810aa service swift] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:56.156305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361f657-172c-4e14-8b3a-9966cd8810aa service swift] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:56.156579 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361f657-172c-4e14-8b3a-9966cd8810aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:56.164867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361f657-172c-4e14-8b3a-9966cd8810aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:56.166446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361f657-172c-4e14-8b3a-9966cd8810aa service swift] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:56.174193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1147/2257] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:29:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:29:58.385100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca880ad-b94a-433e-8418-ed1170e169a4 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:58.386650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-dca880ad-b94a-433e-8418-ed1170e169a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:58.469140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca880ad-b94a-433e-8418-ed1170e169a4 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:58.483349 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:58.484476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:58.484943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:58.485223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] PATH_INFO: `/v3/users/f3f46b66092d4bc8956f979530a04ed4` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:58.486567 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f46b66092d4bc8956f979530a04ed4)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:58.488592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:58.538449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f46b66092d4bc8956f979530a04ed4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:58.546722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f46b66092d4bc8956f979530a04ed4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:58.547648 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f46b66092d4bc8956f979530a04ed4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:58.548302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f46b66092d4bc8956f979530a04ed4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:58.557262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-b42111f6-34e3-4ef2-8885-99c581c898a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f46b66092d4bc8956f979530a04ed4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:58.579455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1111/2258] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:29:58 2021] DELETE /identity/v3/users/f3f46b66092d4bc8956f979530a04ed4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:29:58.786616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361f657-172c-4e14-8b3a-9966cd8810aa service swift] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:58.805516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361f657-172c-4e14-8b3a-9966cd8810aa service swift] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:58.875670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:58.879502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:58.879906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:58.880248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] PATH_INFO: `/v3/projects/3d509ebf5e5a4a77820b0e5ea04090c5` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:58.881588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d509ebf5e5a4a77820b0e5ea04090c5)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:58.883650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:58.933863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d509ebf5e5a4a77820b0e5ea04090c5', 'request_id': 'req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:58.940049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d509ebf5e5a4a77820b0e5ea04090c5', 'request_id': 'req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:58.945772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d509ebf5e5a4a77820b0e5ea04090c5', 'request_id': 'req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:58.957501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] The token cache is being invalidate because project 3d509ebf5e5a4a77820b0e5ea04090c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:29:58.957840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:58.963099 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e4c463e9-065a-4f36-b4b7-f9a7837bc58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:29:58.968792 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1148/2259] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:29:58 2021] DELETE /identity/v3/projects/3d509ebf5e5a4a77820b0e5ea04090c5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:29:58.970788 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee482f3-128f-4dd1-b253-a2c46524bfe8 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:58.971081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee482f3-128f-4dd1-b253-a2c46524bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:58.971359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee482f3-128f-4dd1-b253-a2c46524bfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:58.989287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-eee482f3-128f-4dd1-b253-a2c46524bfe8 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:29:58.990799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-eee482f3-128f-4dd1-b253-a2c46524bfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:59.053644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1112/2260] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:29:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:29:59.061223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8dbe-68e5-4250-9fd2-110a8bc01de4 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:59.061514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8dbe-68e5-4250-9fd2-110a8bc01de4 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:59.061845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8dbe-68e5-4250-9fd2-110a8bc01de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:59.080702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-fecb8dbe-68e5-4250-9fd2-110a8bc01de4 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:29:59.081909 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fecb8dbe-68e5-4250-9fd2-110a8bc01de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:59.091474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1149/2261] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:29:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:29:59.095608 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee482f3-128f-4dd1-b253-a2c46524bfe8 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:59.105704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee482f3-128f-4dd1-b253-a2c46524bfe8 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:59.111381 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02715774-581b-4e08-985f-38952191bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:59.112143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715774-581b-4e08-985f-38952191bc66 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:59.112431 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715774-581b-4e08-985f-38952191bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:59.112707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02715774-581b-4e08-985f-38952191bc66 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:59.113507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02715774-581b-4e08-985f-38952191bc66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:29:59.113908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02715774-581b-4e08-985f-38952191bc66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:59.115990 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02715774-581b-4e08-985f-38952191bc66 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:59.130103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1113/2262] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:29:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:29:59.135978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb8dbe-68e5-4250-9fd2-110a8bc01de4 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:59.145944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb8dbe-68e5-4250-9fd2-110a8bc01de4 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:59.153124 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363ef40-7750-4fed-8437-07c38ee8ea3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:59.153864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363ef40-7750-4fed-8437-07c38ee8ea3f admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:59.154151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363ef40-7750-4fed-8437-07c38ee8ea3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:59.154443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363ef40-7750-4fed-8437-07c38ee8ea3f admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:59.155252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363ef40-7750-4fed-8437-07c38ee8ea3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:59.157168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363ef40-7750-4fed-8437-07c38ee8ea3f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:59.204152 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1150/2263] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:29:59 2021] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:29:59.209671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02715774-581b-4e08-985f-38952191bc66 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:59.223002 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02715774-581b-4e08-985f-38952191bc66 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:59.286106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d6402-f842-4549-bc91-a3807c8dff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:59.286883 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d6402-f842-4549-bc91-a3807c8dff5d admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:59.287256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d6402-f842-4549-bc91-a3807c8dff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:59.287697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d6402-f842-4549-bc91-a3807c8dff5d admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:59.288526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d6402-f842-4549-bc91-a3807c8dff5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:59.291074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d6402-f842-4549-bc91-a3807c8dff5d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:59.312801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1114/2264] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:29:59 2021] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:29:59.316514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363ef40-7750-4fed-8437-07c38ee8ea3f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:59.329345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363ef40-7750-4fed-8437-07c38ee8ea3f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:59.336707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3285dc-9aa4-47ae-bfe4-514ab1aa9bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:59.338228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3285dc-9aa4-47ae-bfe4-514ab1aa9bac admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:59.338769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3285dc-9aa4-47ae-bfe4-514ab1aa9bac admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:59.339372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3285dc-9aa4-47ae-bfe4-514ab1aa9bac admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:59.340345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3285dc-9aa4-47ae-bfe4-514ab1aa9bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:59.342534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3285dc-9aa4-47ae-bfe4-514ab1aa9bac admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:59.356792 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1151/2265] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:29:59 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:29:59.361009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d6402-f842-4549-bc91-a3807c8dff5d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:59.372880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d6402-f842-4549-bc91-a3807c8dff5d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:59.380048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae109c1-6860-4607-a5bc-eca0ac0c1a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:59.380848 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae109c1-6860-4607-a5bc-eca0ac0c1a9a admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:59.381186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae109c1-6860-4607-a5bc-eca0ac0c1a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:59.381464 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae109c1-6860-4607-a5bc-eca0ac0c1a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:59.382219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae109c1-6860-4607-a5bc-eca0ac0c1a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:59.388743 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae109c1-6860-4607-a5bc-eca0ac0c1a9a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:59.400132 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1115/2266] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:29:59 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:29:59.404292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3285dc-9aa4-47ae-bfe4-514ab1aa9bac admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:59.414707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3285dc-9aa4-47ae-bfe4-514ab1aa9bac admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:59.420843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a999c3-3a81-4107-80c6-3fba320abfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:59.421804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a999c3-3a81-4107-80c6-3fba320abfe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:59.422307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a999c3-3a81-4107-80c6-3fba320abfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:59.422826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a999c3-3a81-4107-80c6-3fba320abfe1 admin admin] PATH_INFO: `/v3/projects/af7953fd9085478886e801134807fdaa/users/0a0482a3d16145ee99796f833a2e6ba9/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:59.439775 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a999c3-3a81-4107-80c6-3fba320abfe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7953fd9085478886e801134807fdaa, user_id=0a0482a3d16145ee99796f833a2e6ba9, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:59.442436 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a999c3-3a81-4107-80c6-3fba320abfe1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:59.456099 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1152/2267] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:29:59 2021] PUT /identity/v3/projects/af7953fd9085478886e801134807fdaa/users/0a0482a3d16145ee99796f833a2e6ba9/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:29:59.466048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5308f3-8740-4a55-8589-268509715656 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:59.466340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5308f3-8740-4a55-8589-268509715656 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:59.466604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5308f3-8740-4a55-8589-268509715656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:59.501309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-7d5308f3-8740-4a55-8589-268509715656 None None] MFA Rules not processed for user `0a0482a3d16145ee99796f833a2e6ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:29:59.503405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7d5308f3-8740-4a55-8589-268509715656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:59.579604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1116/2268] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:29:59 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:29:59.589960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a999c3-3a81-4107-80c6-3fba320abfe1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:29:59.592478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-68a999c3-3a81-4107-80c6-3fba320abfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:29:59.657216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a999c3-3a81-4107-80c6-3fba320abfe1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:29:59.660947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b5e58-9455-4fb9-937a-82512fe0594d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:29:59.661656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b5e58-9455-4fb9-937a-82512fe0594d service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:29:59.661905 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b5e58-9455-4fb9-937a-82512fe0594d service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:29:59.662214 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b5e58-9455-4fb9-937a-82512fe0594d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:29:59.671312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b5e58-9455-4fb9-937a-82512fe0594d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:29:59.672742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b5e58-9455-4fb9-937a-82512fe0594d service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:29:59.681421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1153/2269] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:29:59 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:03.146975 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e842d-7dde-413e-99bb-7ce91909868e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:03.147579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e842d-7dde-413e-99bb-7ce91909868e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:03.148348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e842d-7dde-413e-99bb-7ce91909868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:03.178733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c33e842d-7dde-413e-99bb-7ce91909868e None None] MFA Rules not processed for user `0a0482a3d16145ee99796f833a2e6ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:03.180839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c33e842d-7dde-413e-99bb-7ce91909868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:03.209532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1117/2270] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:03 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:04.833546 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b5e58-9455-4fb9-937a-82512fe0594d service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:04.835962 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-038b5e58-9455-4fb9-937a-82512fe0594d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:04.932539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b5e58-9455-4fb9-937a-82512fe0594d service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:04.937067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:04.937965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:04.938243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:04.938520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] PATH_INFO: `/v3/users/d13764d2b0af4d108c1064eb3754c73f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:04.939730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13764d2b0af4d108c1064eb3754c73f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:04.941641 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:04.990828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13764d2b0af4d108c1064eb3754c73f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:05.003371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13764d2b0af4d108c1064eb3754c73f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:05.004062 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13764d2b0af4d108c1064eb3754c73f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:05.012651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13764d2b0af4d108c1064eb3754c73f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:05.013627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13764d2b0af4d108c1064eb3754c73f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:05.034289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1154/2271] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:04 2021] DELETE /identity/v3/users/d13764d2b0af4d108c1064eb3754c73f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:05.040298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e9b20-0a98-4f11-830b-b747a4ad9aa8 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:05.040824 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e9b20-0a98-4f11-830b-b747a4ad9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:05.040920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e9b20-0a98-4f11-830b-b747a4ad9aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:05.063922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-e12e9b20-0a98-4f11-830b-b747a4ad9aa8 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:05.065321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e12e9b20-0a98-4f11-830b-b747a4ad9aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:05.157580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1118/2272] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:05.169611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:05.171476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:05.338699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd35d8a-9202-47e4-b292-1ffeee69e404 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:05.361589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb047e-58c7-4069-97f3-6292bd0f8f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:05.362780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb047e-58c7-4069-97f3-6292bd0f8f65 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:05.363374 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb047e-58c7-4069-97f3-6292bd0f8f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:05.363722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb047e-58c7-4069-97f3-6292bd0f8f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:05.387294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb047e-58c7-4069-97f3-6292bd0f8f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:05.389144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb047e-58c7-4069-97f3-6292bd0f8f65 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:05.408393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1155/2273] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:05.891147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e9b20-0a98-4f11-830b-b747a4ad9aa8 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:05.893164 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e12e9b20-0a98-4f11-830b-b747a4ad9aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:05.953028 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e9b20-0a98-4f11-830b-b747a4ad9aa8 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:05.961104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:05.962204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:05.962662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:05.962970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] PATH_INFO: `/v3/projects/204febb2b66a4eaa9092d2074c9adabb` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:05.964342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=204febb2b66a4eaa9092d2074c9adabb)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:05.966410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:06.031025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204febb2b66a4eaa9092d2074c9adabb', 'request_id': 'req-71549342-081d-4a0c-886f-52cdb2fa0d4a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:06.040566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204febb2b66a4eaa9092d2074c9adabb', 'request_id': 'req-71549342-081d-4a0c-886f-52cdb2fa0d4a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:06.047180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204febb2b66a4eaa9092d2074c9adabb', 'request_id': 'req-71549342-081d-4a0c-886f-52cdb2fa0d4a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:06.063846 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] The token cache is being invalidate because project 204febb2b66a4eaa9092d2074c9adabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:06.064143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:06.067411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-71549342-081d-4a0c-886f-52cdb2fa0d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:06.069187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1119/2274] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:05 2021] DELETE /identity/v3/projects/204febb2b66a4eaa9092d2074c9adabb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:06.075113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a83105-a957-44ac-8eb6-2df500358b43 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:06.075652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a83105-a957-44ac-8eb6-2df500358b43 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:06.075735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a83105-a957-44ac-8eb6-2df500358b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:06.129678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a3a83105-a957-44ac-8eb6-2df500358b43 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:06.130965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a3a83105-a957-44ac-8eb6-2df500358b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:06.187624 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1156/2275] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:06.196337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106a7d9-2d76-440a-b896-e39d4037004e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:06.196626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106a7d9-2d76-440a-b896-e39d4037004e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:06.196910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106a7d9-2d76-440a-b896-e39d4037004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:06.214585 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-0106a7d9-2d76-440a-b896-e39d4037004e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:06.215822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0106a7d9-2d76-440a-b896-e39d4037004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:06.223641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1120/2276] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:06.227949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a83105-a957-44ac-8eb6-2df500358b43 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:06.237745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a83105-a957-44ac-8eb6-2df500358b43 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:06.242970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ca7ab-a739-47e1-a740-4e993b6e7843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:06.243624 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ca7ab-a739-47e1-a740-4e993b6e7843 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:06.243905 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ca7ab-a739-47e1-a740-4e993b6e7843 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:06.244181 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ca7ab-a739-47e1-a740-4e993b6e7843 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:06.244895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ca7ab-a739-47e1-a740-4e993b6e7843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:30:06.245200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ca7ab-a739-47e1-a740-4e993b6e7843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:06.246938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ca7ab-a739-47e1-a740-4e993b6e7843 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:06.262257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1157/2277] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:30:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:30:06.264185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106a7d9-2d76-440a-b896-e39d4037004e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:06.277169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106a7d9-2d76-440a-b896-e39d4037004e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:06.281895 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890f6b9-b3bc-4b7b-9e07-79912bca9454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:06.282572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890f6b9-b3bc-4b7b-9e07-79912bca9454 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:06.282875 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890f6b9-b3bc-4b7b-9e07-79912bca9454 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:06.283151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890f6b9-b3bc-4b7b-9e07-79912bca9454 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:06.283837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890f6b9-b3bc-4b7b-9e07-79912bca9454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:06.285723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890f6b9-b3bc-4b7b-9e07-79912bca9454 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:06.312402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1121/2278] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:06 2021] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:06.326923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ca7ab-a739-47e1-a740-4e993b6e7843 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:06.338499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ca7ab-a739-47e1-a740-4e993b6e7843 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:06.418566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eade21-18fa-4055-b9c1-d34195d98425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:06.422612 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eade21-18fa-4055-b9c1-d34195d98425 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:06.423021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eade21-18fa-4055-b9c1-d34195d98425 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:06.423298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eade21-18fa-4055-b9c1-d34195d98425 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:06.423996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eade21-18fa-4055-b9c1-d34195d98425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:06.429763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eade21-18fa-4055-b9c1-d34195d98425 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:06.462966 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1158/2279] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:06 2021] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:06.468476 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890f6b9-b3bc-4b7b-9e07-79912bca9454 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:06.480688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890f6b9-b3bc-4b7b-9e07-79912bca9454 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:06.492329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0eaaa2-e2a4-4bf8-9ca3-667682426a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:06.492999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eaaa2-e2a4-4bf8-9ca3-667682426a32 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:06.494096 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eaaa2-e2a4-4bf8-9ca3-667682426a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:06.494572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eaaa2-e2a4-4bf8-9ca3-667682426a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:06.495548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0eaaa2-e2a4-4bf8-9ca3-667682426a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:06.497492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0eaaa2-e2a4-4bf8-9ca3-667682426a32 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:06.532560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eade21-18fa-4055-b9c1-d34195d98425 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:06.532766 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1122/2280] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:06 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:06.551326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eade21-18fa-4055-b9c1-d34195d98425 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:06.557015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414795f-1e62-467a-b4c3-5bb69d07c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:06.558128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414795f-1e62-467a-b4c3-5bb69d07c6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:06.558590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414795f-1e62-467a-b4c3-5bb69d07c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:06.559069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414795f-1e62-467a-b4c3-5bb69d07c6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:06.560266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414795f-1e62-467a-b4c3-5bb69d07c6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:06.563178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414795f-1e62-467a-b4c3-5bb69d07c6e0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:06.585198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1159/2281] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:06 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:06.589177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0eaaa2-e2a4-4bf8-9ca3-667682426a32 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:06.604267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0eaaa2-e2a4-4bf8-9ca3-667682426a32 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:06.613675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fbe45-e400-4a00-b419-9f15b818062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:06.614810 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fbe45-e400-4a00-b419-9f15b818062b admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:06.615328 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fbe45-e400-4a00-b419-9f15b818062b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:06.615723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fbe45-e400-4a00-b419-9f15b818062b admin admin] PATH_INFO: `/v3/projects/91561edb5be742c6b2dfc64b3ffb7be2/users/756311ff29b94ccdbb85e2e8ac259f2d/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:06.644736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fbe45-e400-4a00-b419-9f15b818062b admin admin] RBAC: Authorizing `identity:create_grant(project_id=91561edb5be742c6b2dfc64b3ffb7be2, user_id=756311ff29b94ccdbb85e2e8ac259f2d, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:06.648058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fbe45-e400-4a00-b419-9f15b818062b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:06.667550 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1123/2282] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:06 2021] PUT /identity/v3/projects/91561edb5be742c6b2dfc64b3ffb7be2/users/756311ff29b94ccdbb85e2e8ac259f2d/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:06.673344 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f60251-93c5-4e50-bd4e-4efae12dacd9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:06.674394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f60251-93c5-4e50-bd4e-4efae12dacd9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:06.674999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f60251-93c5-4e50-bd4e-4efae12dacd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:06.696653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b5f60251-93c5-4e50-bd4e-4efae12dacd9 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:06.698086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b5f60251-93c5-4e50-bd4e-4efae12dacd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:06.767949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1160/2283] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:06.782024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fbe45-e400-4a00-b419-9f15b818062b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:06.784413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f39fbe45-e400-4a00-b419-9f15b818062b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:06.864435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fbe45-e400-4a00-b419-9f15b818062b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:06.871069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a8a6e-ada8-4e8f-bfc2-e2b7ea86acab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:06.872253 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a8a6e-ada8-4e8f-bfc2-e2b7ea86acab service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:06.872873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a8a6e-ada8-4e8f-bfc2-e2b7ea86acab service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:06.873330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a8a6e-ada8-4e8f-bfc2-e2b7ea86acab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:06.883396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a8a6e-ada8-4e8f-bfc2-e2b7ea86acab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:06.885579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a8a6e-ada8-4e8f-bfc2-e2b7ea86acab service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:06.900974 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1124/2284] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:30:07.632985 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f60251-93c5-4e50-bd4e-4efae12dacd9 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:07.634446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b5f60251-93c5-4e50-bd4e-4efae12dacd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:07.648768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f60251-93c5-4e50-bd4e-4efae12dacd9 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:07.653729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:07.654610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:07.654928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:07.655202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] PATH_INFO: `/v3/users/98f1e16f64334033959655f66c3caa9b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:07.656403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f1e16f64334033959655f66c3caa9b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:07.658323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:07.718256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f1e16f64334033959655f66c3caa9b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:07.733223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f1e16f64334033959655f66c3caa9b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:07.739108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f1e16f64334033959655f66c3caa9b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:07.745852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f1e16f64334033959655f66c3caa9b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:07.746507 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f1e16f64334033959655f66c3caa9b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:07.759629 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1161/2285] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:07 2021] DELETE /identity/v3/users/98f1e16f64334033959655f66c3caa9b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:07.764273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721dcc0-cecf-4bb8-9e68-e30795cf1340 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:07.765119 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721dcc0-cecf-4bb8-9e68-e30795cf1340 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:07.765402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721dcc0-cecf-4bb8-9e68-e30795cf1340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:07.784148 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-2721dcc0-cecf-4bb8-9e68-e30795cf1340 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:07.785596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2721dcc0-cecf-4bb8-9e68-e30795cf1340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:07.853232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1125/2286] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:07.871681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:07.873150 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:07.963148 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28c1b-145b-4a6a-b915-ee4ee6f23260 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:07.967934 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb252099-7a33-4a97-8096-729f4b40a6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:07.968952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb252099-7a33-4a97-8096-729f4b40a6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:07.969470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb252099-7a33-4a97-8096-729f4b40a6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:07.970114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb252099-7a33-4a97-8096-729f4b40a6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:07.985342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb252099-7a33-4a97-8096-729f4b40a6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:07.987545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb252099-7a33-4a97-8096-729f4b40a6b0 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:07.999625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1162/2287] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:30:08.355633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721dcc0-cecf-4bb8-9e68-e30795cf1340 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:08.357382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2721dcc0-cecf-4bb8-9e68-e30795cf1340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:08.372478 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721dcc0-cecf-4bb8-9e68-e30795cf1340 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:08.378378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:08.379346 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:08.380287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:08.380867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] PATH_INFO: `/v3/projects/31f1aac16d6d44079483398dc5cd0355` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:08.384506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f1aac16d6d44079483398dc5cd0355)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:08.386897 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:08.433222 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f1aac16d6d44079483398dc5cd0355', 'request_id': 'req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:08.439487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f1aac16d6d44079483398dc5cd0355', 'request_id': 'req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:08.446608 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f1aac16d6d44079483398dc5cd0355', 'request_id': 'req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:08.463063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] The token cache is being invalidate because project 31f1aac16d6d44079483398dc5cd0355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:08.463439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:08.464182 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2f9e39c2-f11b-4e59-a905-5d4aaa74b541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:08.466184 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1126/2288] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:08 2021] DELETE /identity/v3/projects/31f1aac16d6d44079483398dc5cd0355 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:08.472061 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73363c-e763-4307-8f8d-ff81868d5491 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:08.472373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73363c-e763-4307-8f8d-ff81868d5491 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:08.472658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73363c-e763-4307-8f8d-ff81868d5491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:08.496492 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-4c73363c-e763-4307-8f8d-ff81868d5491 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:08.498294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4c73363c-e763-4307-8f8d-ff81868d5491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:08.588594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f033c-4b44-48f9-a34f-21090267bd30 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:08.588924 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f033c-4b44-48f9-a34f-21090267bd30 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:08.589155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f033c-4b44-48f9-a34f-21090267bd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:08.632859 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1163/2289] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:08.636819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-264f033c-4b44-48f9-a34f-21090267bd30 None None] MFA Rules not processed for user `756311ff29b94ccdbb85e2e8ac259f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:08.641852 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e32516-5d5b-4a83-90bc-8f71d84e4fea None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:08.642352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e32516-5d5b-4a83-90bc-8f71d84e4fea None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:08.642458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e32516-5d5b-4a83-90bc-8f71d84e4fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:08.642984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-264f033c-4b44-48f9-a34f-21090267bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:08.687659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-75e32516-5d5b-4a83-90bc-8f71d84e4fea None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:08.696357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-75e32516-5d5b-4a83-90bc-8f71d84e4fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:08.709325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1164/2290] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:08.713066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e32516-5d5b-4a83-90bc-8f71d84e4fea None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:08.735244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e32516-5d5b-4a83-90bc-8f71d84e4fea None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:08.737069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1127/2291] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:08 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:08.740877 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a4163-1c0d-4bd8-87dd-29b9f843ef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:08.742122 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a4163-1c0d-4bd8-87dd-29b9f843ef75 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:08.742421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a4163-1c0d-4bd8-87dd-29b9f843ef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:08.742939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a4163-1c0d-4bd8-87dd-29b9f843ef75 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:08.744024 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a4163-1c0d-4bd8-87dd-29b9f843ef75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:30:08.744560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a4163-1c0d-4bd8-87dd-29b9f843ef75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:08.745586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f033c-4b44-48f9-a34f-21090267bd30 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:08.746620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a4163-1c0d-4bd8-87dd-29b9f843ef75 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:08.747144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-264f033c-4b44-48f9-a34f-21090267bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:08.763029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1165/2292] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:30:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:30:08.767405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a4163-1c0d-4bd8-87dd-29b9f843ef75 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:08.784693 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a4163-1c0d-4bd8-87dd-29b9f843ef75 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:08.800918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a859645-a344-4f79-8bd6-08d6f764ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:08.801557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859645-a344-4f79-8bd6-08d6f764ab94 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:08.801853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859645-a344-4f79-8bd6-08d6f764ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:08.802119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859645-a344-4f79-8bd6-08d6f764ab94 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:08.802856 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a859645-a344-4f79-8bd6-08d6f764ab94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:08.805487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a859645-a344-4f79-8bd6-08d6f764ab94 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:08.844977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f033c-4b44-48f9-a34f-21090267bd30 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:08.865563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d47b30-000c-4dd6-8530-0b5eb33a2639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:08.865999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1166/2293] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:08 2021] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:08.871087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a859645-a344-4f79-8bd6-08d6f764ab94 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:08.871428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d47b30-000c-4dd6-8530-0b5eb33a2639 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:08.871738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d47b30-000c-4dd6-8530-0b5eb33a2639 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:08.872243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d47b30-000c-4dd6-8530-0b5eb33a2639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:08.896713 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d47b30-000c-4dd6-8530-0b5eb33a2639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:08.899614 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d47b30-000c-4dd6-8530-0b5eb33a2639 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:08.911079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1128/2294] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:08 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:09.001533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a859645-a344-4f79-8bd6-08d6f764ab94 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:09.011832 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a71c-db92-4b08-a858-4be1051f810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:09.012623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a71c-db92-4b08-a858-4be1051f810b admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:09.012976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a71c-db92-4b08-a858-4be1051f810b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:09.013576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a71c-db92-4b08-a858-4be1051f810b admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:09.014329 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387a71c-db92-4b08-a858-4be1051f810b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:09.016532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387a71c-db92-4b08-a858-4be1051f810b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:09.061745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1167/2295] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:08 2021] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:09.066828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d47b30-000c-4dd6-8530-0b5eb33a2639 service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:09.081751 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d47b30-000c-4dd6-8530-0b5eb33a2639 service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:09.094604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6666d8b-3f29-41dd-85b2-b801d762bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:09.095389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6666d8b-3f29-41dd-85b2-b801d762bdba admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:09.095606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6666d8b-3f29-41dd-85b2-b801d762bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:09.096037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6666d8b-3f29-41dd-85b2-b801d762bdba admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:09.096768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6666d8b-3f29-41dd-85b2-b801d762bdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:09.098355 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6666d8b-3f29-41dd-85b2-b801d762bdba admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:09.109487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1129/2296] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:09 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:09.113502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a71c-db92-4b08-a858-4be1051f810b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:09.126921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a71c-db92-4b08-a858-4be1051f810b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:09.138737 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965112d0-590f-4a40-9486-5aa4d0bed3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:09.139451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965112d0-590f-4a40-9486-5aa4d0bed3fb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:09.140143 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965112d0-590f-4a40-9486-5aa4d0bed3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:09.140475 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965112d0-590f-4a40-9486-5aa4d0bed3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:09.141369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965112d0-590f-4a40-9486-5aa4d0bed3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:09.143276 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965112d0-590f-4a40-9486-5aa4d0bed3fb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:09.157409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1168/2297] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:09 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:09.161497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6666d8b-3f29-41dd-85b2-b801d762bdba admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:09.172717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6666d8b-3f29-41dd-85b2-b801d762bdba admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:09.177546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20dbc0-7d61-4741-9aa7-112241034374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:09.179304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20dbc0-7d61-4741-9aa7-112241034374 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:09.179804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20dbc0-7d61-4741-9aa7-112241034374 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:09.180171 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20dbc0-7d61-4741-9aa7-112241034374 admin admin] PATH_INFO: `/v3/projects/5cb27506683c4528bf82439391514d33/users/a444ef975c264f67af2a70129247d301/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:09.197610 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20dbc0-7d61-4741-9aa7-112241034374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb27506683c4528bf82439391514d33, user_id=a444ef975c264f67af2a70129247d301, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:09.201241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20dbc0-7d61-4741-9aa7-112241034374 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:09.222223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1130/2298] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:09 2021] PUT /identity/v3/projects/5cb27506683c4528bf82439391514d33/users/a444ef975c264f67af2a70129247d301/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:09.232561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a9511-f634-4ccd-90e3-5b355d6412e3 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:09.232848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a9511-f634-4ccd-90e3-5b355d6412e3 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:09.233128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a9511-f634-4ccd-90e3-5b355d6412e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:09.271981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a87a9511-f634-4ccd-90e3-5b355d6412e3 None None] MFA Rules not processed for user `a444ef975c264f67af2a70129247d301`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:09.273243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a87a9511-f634-4ccd-90e3-5b355d6412e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:09.405020 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1169/2299] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:09 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:09.416949 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20dbc0-7d61-4741-9aa7-112241034374 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:09.477110 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20dbc0-7d61-4741-9aa7-112241034374 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:09.480865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77137def-d1cb-47b2-9585-da2c466538bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:09.481817 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77137def-d1cb-47b2-9585-da2c466538bb service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:09.482128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77137def-d1cb-47b2-9585-da2c466538bb service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:09.482411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77137def-d1cb-47b2-9585-da2c466538bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:09.496668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77137def-d1cb-47b2-9585-da2c466538bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:09.498110 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77137def-d1cb-47b2-9585-da2c466538bb service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:09.511597 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1131/2300] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:09 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:09.540864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a9511-f634-4ccd-90e3-5b355d6412e3 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:09.601686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a9511-f634-4ccd-90e3-5b355d6412e3 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:09.606240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:09.607135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:09.607424 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:09.607706 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] PATH_INFO: `/v3/users/a444ef975c264f67af2a70129247d301` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:09.608889 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a444ef975c264f67af2a70129247d301)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:09.610850 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:09.654485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a444ef975c264f67af2a70129247d301'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:09.667052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a444ef975c264f67af2a70129247d301'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:09.667782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a444ef975c264f67af2a70129247d301'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:09.674860 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a444ef975c264f67af2a70129247d301'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:09.675483 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a444ef975c264f67af2a70129247d301'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:09.688985 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1170/2301] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:09 2021] DELETE /identity/v3/users/a444ef975c264f67af2a70129247d301 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:09.693207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccfd82-c028-479e-b716-7eb7969511e3 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:09.693509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccfd82-c028-479e-b716-7eb7969511e3 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:09.693779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccfd82-c028-479e-b716-7eb7969511e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:09.712000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-17ccfd82-c028-479e-b716-7eb7969511e3 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:09.713265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-17ccfd82-c028-479e-b716-7eb7969511e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:09.774536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1132/2302] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:09.784612 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:09.786062 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:09.844891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de450f-cc28-40cb-9970-9f01b273bcc7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:09.848643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ef927-6f41-4863-8fdb-00e7670aa7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:09.849293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ef927-6f41-4863-8fdb-00e7670aa7cb service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:09.849584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ef927-6f41-4863-8fdb-00e7670aa7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:09.849864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ef927-6f41-4863-8fdb-00e7670aa7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:09.859517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ef927-6f41-4863-8fdb-00e7670aa7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:09.860947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ef927-6f41-4863-8fdb-00e7670aa7cb service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:09.870273 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1171/2303] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:10.159938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccfd82-c028-479e-b716-7eb7969511e3 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:10.161486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-17ccfd82-c028-479e-b716-7eb7969511e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:10.189119 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccfd82-c028-479e-b716-7eb7969511e3 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:10.193742 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:10.194653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.194970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.195250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] PATH_INFO: `/v3/projects/5cb27506683c4528bf82439391514d33` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.197931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb27506683c4528bf82439391514d33)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:10.199455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:10.248648 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb27506683c4528bf82439391514d33', 'request_id': 'req-2c9114a0-a193-4daf-a563-5696bc12a554'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:10.254881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb27506683c4528bf82439391514d33', 'request_id': 'req-2c9114a0-a193-4daf-a563-5696bc12a554'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:10.260469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb27506683c4528bf82439391514d33', 'request_id': 'req-2c9114a0-a193-4daf-a563-5696bc12a554'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:10.272758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] The token cache is being invalidate because project 5cb27506683c4528bf82439391514d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:10.273054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:10.273673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2c9114a0-a193-4daf-a563-5696bc12a554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:10.275247 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1133/2304] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:10 2021] DELETE /identity/v3/projects/5cb27506683c4528bf82439391514d33 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:10.281093 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581453f-4eaf-41d8-8ee1-90cfce32116f None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.281385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581453f-4eaf-41d8-8ee1-90cfce32116f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.281665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581453f-4eaf-41d8-8ee1-90cfce32116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.299918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b581453f-4eaf-41d8-8ee1-90cfce32116f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:10.301212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b581453f-4eaf-41d8-8ee1-90cfce32116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:10.358698 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1172/2305] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:10.367051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3138c-df2f-4e2f-b35d-950ed7823b95 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.367348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3138c-df2f-4e2f-b35d-950ed7823b95 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.367629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3138c-df2f-4e2f-b35d-950ed7823b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.385588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-e4a3138c-df2f-4e2f-b35d-950ed7823b95 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:10.386817 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e4a3138c-df2f-4e2f-b35d-950ed7823b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:10.397000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1134/2306] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:10.401104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581453f-4eaf-41d8-8ee1-90cfce32116f None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:10.412027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581453f-4eaf-41d8-8ee1-90cfce32116f None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:10.418999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a313fe-7086-429f-a196-22f28ff2cff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:10.419656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a313fe-7086-429f-a196-22f28ff2cff4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.419989 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a313fe-7086-429f-a196-22f28ff2cff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.420213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a313fe-7086-429f-a196-22f28ff2cff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.420944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a313fe-7086-429f-a196-22f28ff2cff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:30:10.421261 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a313fe-7086-429f-a196-22f28ff2cff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:10.422904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a313fe-7086-429f-a196-22f28ff2cff4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:10.436758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1173/2307] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:30:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:30:10.443266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3138c-df2f-4e2f-b35d-950ed7823b95 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:10.453281 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3138c-df2f-4e2f-b35d-950ed7823b95 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:10.455586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63da916-6be6-487d-89dd-1eb82e3732ee None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.455981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63da916-6be6-487d-89dd-1eb82e3732ee None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.456194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63da916-6be6-487d-89dd-1eb82e3732ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.460953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f68ef-6941-4dc8-a3a7-6dfa94971845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:10.461761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f68ef-6941-4dc8-a3a7-6dfa94971845 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.462066 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f68ef-6941-4dc8-a3a7-6dfa94971845 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.462468 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f68ef-6941-4dc8-a3a7-6dfa94971845 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.463193 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f68ef-6941-4dc8-a3a7-6dfa94971845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:10.465095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f68ef-6941-4dc8-a3a7-6dfa94971845 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:10.474925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e63da916-6be6-487d-89dd-1eb82e3732ee None None] MFA Rules not processed for user `756311ff29b94ccdbb85e2e8ac259f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:10.476708 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e63da916-6be6-487d-89dd-1eb82e3732ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:10.502942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1135/2308] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:10 2021] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:10.508301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f68ef-6941-4dc8-a3a7-6dfa94971845 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:10.543914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1174/2309] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:10 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:10.576277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f68ef-6941-4dc8-a3a7-6dfa94971845 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:10.580968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aca73-9e78-4699-b2d7-149464a3945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:10.581607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aca73-9e78-4699-b2d7-149464a3945d admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.581891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aca73-9e78-4699-b2d7-149464a3945d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.582168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aca73-9e78-4699-b2d7-149464a3945d admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.582885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aca73-9e78-4699-b2d7-149464a3945d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:10.584771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aca73-9e78-4699-b2d7-149464a3945d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:10.609345 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1136/2310] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:10 2021] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:10.610350 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63da916-6be6-487d-89dd-1eb82e3732ee None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:10.621038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63da916-6be6-487d-89dd-1eb82e3732ee None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:10.626110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9db5b-4a7c-4b33-aa4c-2fa89833a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:10.626825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9db5b-4a7c-4b33-aa4c-2fa89833a66d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.627113 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9db5b-4a7c-4b33-aa4c-2fa89833a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.627389 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9db5b-4a7c-4b33-aa4c-2fa89833a66d admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.628112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9db5b-4a7c-4b33-aa4c-2fa89833a66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:10.629707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9db5b-4a7c-4b33-aa4c-2fa89833a66d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:10.640829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1175/2311] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:10 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:10.645251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aca73-9e78-4699-b2d7-149464a3945d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:10.658755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aca73-9e78-4699-b2d7-149464a3945d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:10.663891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae8815-b651-4311-bbc0-fcb40e0dc474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:10.664572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8815-b651-4311-bbc0-fcb40e0dc474 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.664850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8815-b651-4311-bbc0-fcb40e0dc474 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.665121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8815-b651-4311-bbc0-fcb40e0dc474 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.665853 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae8815-b651-4311-bbc0-fcb40e0dc474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:10.667816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae8815-b651-4311-bbc0-fcb40e0dc474 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:10.680057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1137/2312] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:10 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:10.684206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9db5b-4a7c-4b33-aa4c-2fa89833a66d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:10.694222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9db5b-4a7c-4b33-aa4c-2fa89833a66d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:10.698951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94965806-daa7-48d1-90fd-8ccd3d1107c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:10.699835 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94965806-daa7-48d1-90fd-8ccd3d1107c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.700118 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94965806-daa7-48d1-90fd-8ccd3d1107c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.700393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94965806-daa7-48d1-90fd-8ccd3d1107c3 admin admin] PATH_INFO: `/v3/projects/c6f141f452f148898f2cbbf134e41a6d/users/52b90ff9898f4cf2bb661469bbfd328a/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.715163 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94965806-daa7-48d1-90fd-8ccd3d1107c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f141f452f148898f2cbbf134e41a6d, user_id=52b90ff9898f4cf2bb661469bbfd328a, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:10.717837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94965806-daa7-48d1-90fd-8ccd3d1107c3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:10.733016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1176/2313] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:10 2021] PUT /identity/v3/projects/c6f141f452f148898f2cbbf134e41a6d/users/52b90ff9898f4cf2bb661469bbfd328a/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:10.743598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c3b1-0937-41c4-9a3f-59c1897f63ca None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.743893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c3b1-0937-41c4-9a3f-59c1897f63ca None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.744172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c3b1-0937-41c4-9a3f-59c1897f63ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.770449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-56b4c3b1-0937-41c4-9a3f-59c1897f63ca None None] MFA Rules not processed for user `52b90ff9898f4cf2bb661469bbfd328a`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:10.771696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-56b4c3b1-0937-41c4-9a3f-59c1897f63ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:10.836633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1138/2314] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:10 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:10.849466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94965806-daa7-48d1-90fd-8ccd3d1107c3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:10.851508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-94965806-daa7-48d1-90fd-8ccd3d1107c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:10.911682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94965806-daa7-48d1-90fd-8ccd3d1107c3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:10.915566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894bb03-d7e7-47f4-9ce9-a9e474f24318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:10.916517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894bb03-d7e7-47f4-9ce9-a9e474f24318 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:10.916807 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894bb03-d7e7-47f4-9ce9-a9e474f24318 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:10.917080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894bb03-d7e7-47f4-9ce9-a9e474f24318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:10.927242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894bb03-d7e7-47f4-9ce9-a9e474f24318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:10.928684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894bb03-d7e7-47f4-9ce9-a9e474f24318 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:10.938963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1177/2315] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:10 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:15.316985 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4c3b1-0937-41c4-9a3f-59c1897f63ca None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:15.318430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-56b4c3b1-0937-41c4-9a3f-59c1897f63ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:15.383636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4c3b1-0937-41c4-9a3f-59c1897f63ca None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:15.388067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:15.389176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:15.389459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:15.389735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] PATH_INFO: `/v3/users/d2f7490ad6cf4bed96cfec8a39a65b43` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:15.390946 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f7490ad6cf4bed96cfec8a39a65b43)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:15.392862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:15.436662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f7490ad6cf4bed96cfec8a39a65b43'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:15.443306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f7490ad6cf4bed96cfec8a39a65b43'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:15.443991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f7490ad6cf4bed96cfec8a39a65b43'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:15.444593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f7490ad6cf4bed96cfec8a39a65b43'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:15.451393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c812b237-004a-467e-8f71-2c455010f834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f7490ad6cf4bed96cfec8a39a65b43'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:15.467470 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1139/2316] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:15 2021] DELETE /identity/v3/users/d2f7490ad6cf4bed96cfec8a39a65b43 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:15.635045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894bb03-d7e7-47f4-9ce9-a9e474f24318 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:15.654383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894bb03-d7e7-47f4-9ce9-a9e474f24318 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:15.718395 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:15.719310 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:15.719595 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:15.719870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] PATH_INFO: `/v3/projects/46fe21ec575f40a0b26f9482a77b5a73` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:15.721029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=46fe21ec575f40a0b26f9482a77b5a73)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:15.722950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:15.786662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46fe21ec575f40a0b26f9482a77b5a73', 'request_id': 'req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:15.796793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46fe21ec575f40a0b26f9482a77b5a73', 'request_id': 'req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:15.809450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46fe21ec575f40a0b26f9482a77b5a73', 'request_id': 'req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:15.826324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] The token cache is being invalidate because project 46fe21ec575f40a0b26f9482a77b5a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:15.827323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:15.827323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8fcd69d-cca8-4533-826f-76fbe37c8a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:15.829364 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1178/2317] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:15 2021] DELETE /identity/v3/projects/46fe21ec575f40a0b26f9482a77b5a73 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:15.835422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf4bdd-db70-4759-a7d4-7331e258cfdf None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:15.835714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf4bdd-db70-4759-a7d4-7331e258cfdf None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:15.836254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf4bdd-db70-4759-a7d4-7331e258cfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:15.856933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-ecdf4bdd-db70-4759-a7d4-7331e258cfdf None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:15.858180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ecdf4bdd-db70-4759-a7d4-7331e258cfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:15.948576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1140/2318] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:15.956259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db728b7-b9f3-47d9-9af7-8091aaed7f92 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:15.956545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db728b7-b9f3-47d9-9af7-8091aaed7f92 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:15.956851 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db728b7-b9f3-47d9-9af7-8091aaed7f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:15.980980 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-3db728b7-b9f3-47d9-9af7-8091aaed7f92 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:15.983349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3db728b7-b9f3-47d9-9af7-8091aaed7f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:15.996670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1179/2319] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:15.997621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf4bdd-db70-4759-a7d4-7331e258cfdf None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.009052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf4bdd-db70-4759-a7d4-7331e258cfdf None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.020095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c897b2-dfdd-4378-9b21-39016d942c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.021029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c897b2-dfdd-4378-9b21-39016d942c47 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.021319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c897b2-dfdd-4378-9b21-39016d942c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.021709 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c897b2-dfdd-4378-9b21-39016d942c47 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.023205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c897b2-dfdd-4378-9b21-39016d942c47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:30:16.023523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c897b2-dfdd-4378-9b21-39016d942c47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.025976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c897b2-dfdd-4378-9b21-39016d942c47 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.039939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1141/2320] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:30:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:30:16.044247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db728b7-b9f3-47d9-9af7-8091aaed7f92 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.053439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db728b7-b9f3-47d9-9af7-8091aaed7f92 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.058176 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239950a-51c9-492a-8b8c-5c42024addf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.058875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239950a-51c9-492a-8b8c-5c42024addf0 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.059186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239950a-51c9-492a-8b8c-5c42024addf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.059571 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239950a-51c9-492a-8b8c-5c42024addf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.060538 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239950a-51c9-492a-8b8c-5c42024addf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.062637 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239950a-51c9-492a-8b8c-5c42024addf0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.091042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1180/2321] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:16 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:30:16.094978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c897b2-dfdd-4378-9b21-39016d942c47 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.118102 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c897b2-dfdd-4378-9b21-39016d942c47 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.183679 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76e83-9445-40af-ba88-c509bbe6b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.184414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76e83-9445-40af-ba88-c509bbe6b80e admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.184770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76e83-9445-40af-ba88-c509bbe6b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.185109 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76e83-9445-40af-ba88-c509bbe6b80e admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.185885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf76e83-9445-40af-ba88-c509bbe6b80e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.187936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf76e83-9445-40af-ba88-c509bbe6b80e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.222829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1142/2322] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:16 2021] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:30:16.226800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239950a-51c9-492a-8b8c-5c42024addf0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.237764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239950a-51c9-492a-8b8c-5c42024addf0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.254145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85767fe-292f-495f-996d-7fb9f4b5ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.254943 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85767fe-292f-495f-996d-7fb9f4b5ec67 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.255234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85767fe-292f-495f-996d-7fb9f4b5ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.256049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85767fe-292f-495f-996d-7fb9f4b5ec67 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.256248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85767fe-292f-495f-996d-7fb9f4b5ec67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.258411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85767fe-292f-495f-996d-7fb9f4b5ec67 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.273692 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1181/2323] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:16 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:16.274760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76e83-9445-40af-ba88-c509bbe6b80e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.290865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76e83-9445-40af-ba88-c509bbe6b80e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.306405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc5943-455e-4441-8a32-7c45942e7397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.307121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc5943-455e-4441-8a32-7c45942e7397 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.307407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc5943-455e-4441-8a32-7c45942e7397 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.307687 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc5943-455e-4441-8a32-7c45942e7397 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.308535 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc5943-455e-4441-8a32-7c45942e7397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.310260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc5943-455e-4441-8a32-7c45942e7397 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.323320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1143/2324] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:16 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:30:16.328043 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85767fe-292f-495f-996d-7fb9f4b5ec67 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.343891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85767fe-292f-495f-996d-7fb9f4b5ec67 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.355471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0ef16-ac8c-436e-a130-aabeffa64804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.356408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ef16-ac8c-436e-a130-aabeffa64804 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.356694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ef16-ac8c-436e-a130-aabeffa64804 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.356976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ef16-ac8c-436e-a130-aabeffa64804 admin admin] PATH_INFO: `/v3/projects/ba9eac01c6b84edf909a4b04d16d6aef/users/fd5d1c48c1834c44af1100147772c657/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.388537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0ef16-ac8c-436e-a130-aabeffa64804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9eac01c6b84edf909a4b04d16d6aef, user_id=fd5d1c48c1834c44af1100147772c657, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.393497 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0ef16-ac8c-436e-a130-aabeffa64804 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.430112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1182/2325] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:16 2021] PUT /identity/v3/projects/ba9eac01c6b84edf909a4b04d16d6aef/users/fd5d1c48c1834c44af1100147772c657/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:16.431782 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c243d14-7060-49aa-8a61-b3434bd3c629 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.432081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c243d14-7060-49aa-8a61-b3434bd3c629 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.432364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c243d14-7060-49aa-8a61-b3434bd3c629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.470083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-3c243d14-7060-49aa-8a61-b3434bd3c629 None None] MFA Rules not processed for user `fd5d1c48c1834c44af1100147772c657`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:16.471371 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3c243d14-7060-49aa-8a61-b3434bd3c629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:16.580666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1144/2326] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:16 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:16.584898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0ef16-ac8c-436e-a130-aabeffa64804 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.654183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0ef16-ac8c-436e-a130-aabeffa64804 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.662539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd11ba9-b804-4385-879b-9c465015fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.663293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11ba9-b804-4385-879b-9c465015fec9 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.663574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11ba9-b804-4385-879b-9c465015fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.663847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11ba9-b804-4385-879b-9c465015fec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.664662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd11ba9-b804-4385-879b-9c465015fec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.668482 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd11ba9-b804-4385-879b-9c465015fec9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.694869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1183/2327] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:16 2021] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:16.698831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c243d14-7060-49aa-8a61-b3434bd3c629 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.710428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c243d14-7060-49aa-8a61-b3434bd3c629 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.780913 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c993ad-703b-455a-bd56-cbcaed3bcafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.781607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c993ad-703b-455a-bd56-cbcaed3bcafd admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.781887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c993ad-703b-455a-bd56-cbcaed3bcafd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.782195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c993ad-703b-455a-bd56-cbcaed3bcafd admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.782964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c993ad-703b-455a-bd56-cbcaed3bcafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.784855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c993ad-703b-455a-bd56-cbcaed3bcafd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.807934 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1145/2328] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:16 2021] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:16.809192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd11ba9-b804-4385-879b-9c465015fec9 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.823619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd11ba9-b804-4385-879b-9c465015fec9 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.824227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa95ca-b5f7-4f90-90ec-863a554fcb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.824896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa95ca-b5f7-4f90-90ec-863a554fcb1e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.825179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa95ca-b5f7-4f90-90ec-863a554fcb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.825456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa95ca-b5f7-4f90-90ec-863a554fcb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.826177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa95ca-b5f7-4f90-90ec-863a554fcb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.827821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa95ca-b5f7-4f90-90ec-863a554fcb1e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.839443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1184/2329] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:16.843812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c993ad-703b-455a-bd56-cbcaed3bcafd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.854550 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c993ad-703b-455a-bd56-cbcaed3bcafd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.859214 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119fb0a-c093-453b-a70b-1730b9322c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.860182 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119fb0a-c093-453b-a70b-1730b9322c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.860400 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119fb0a-c093-453b-a70b-1730b9322c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.860880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119fb0a-c093-453b-a70b-1730b9322c6b admin admin] PATH_INFO: `/v3/projects/ef2099d9ceef4ad6bf73b8414172740f/users/f302e12c6683479eb12d22240cf4bfd2/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.877055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119fb0a-c093-453b-a70b-1730b9322c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2099d9ceef4ad6bf73b8414172740f, user_id=f302e12c6683479eb12d22240cf4bfd2, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.879757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119fb0a-c093-453b-a70b-1730b9322c6b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.893530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1146/2330] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:16 2021] PUT /identity/v3/projects/ef2099d9ceef4ad6bf73b8414172740f/users/f302e12c6683479eb12d22240cf4bfd2/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:16.898253 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa95ca-b5f7-4f90-90ec-863a554fcb1e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:16.908512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa95ca-b5f7-4f90-90ec-863a554fcb1e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:16.971710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b08287-4503-4d42-a497-e2035af50a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:16.972394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08287-4503-4d42-a497-e2035af50a13 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:16.972681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08287-4503-4d42-a497-e2035af50a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:16.972962 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b08287-4503-4d42-a497-e2035af50a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:16.973697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b08287-4503-4d42-a497-e2035af50a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:16.975557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b08287-4503-4d42-a497-e2035af50a13 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:16.986127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1185/2331] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:16 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:16.990342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119fb0a-c093-453b-a70b-1730b9322c6b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:17.000988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119fb0a-c093-453b-a70b-1730b9322c6b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:17.005897 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8734ab-52f9-444d-b09e-c70fcb76a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:17.007734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8734ab-52f9-444d-b09e-c70fcb76a389 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:17.007851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8734ab-52f9-444d-b09e-c70fcb76a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:17.008258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8734ab-52f9-444d-b09e-c70fcb76a389 admin admin] PATH_INFO: `/v3/projects/ef2099d9ceef4ad6bf73b8414172740f/users/f302e12c6683479eb12d22240cf4bfd2/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:17.010387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8734ab-52f9-444d-b09e-c70fcb76a389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2099d9ceef4ad6bf73b8414172740f, user_id=f302e12c6683479eb12d22240cf4bfd2, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:17.013387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8734ab-52f9-444d-b09e-c70fcb76a389 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:17.024743 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1147/2332] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:16 2021] PUT /identity/v3/projects/ef2099d9ceef4ad6bf73b8414172740f/users/f302e12c6683479eb12d22240cf4bfd2/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:17.035804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26035-a2a7-4f5d-a759-b3a157bdda5f None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:17.036094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26035-a2a7-4f5d-a759-b3a157bdda5f None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:17.036369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26035-a2a7-4f5d-a759-b3a157bdda5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:17.075231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a1e26035-a2a7-4f5d-a759-b3a157bdda5f None None] MFA Rules not processed for user `f302e12c6683479eb12d22240cf4bfd2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:17.076498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a1e26035-a2a7-4f5d-a759-b3a157bdda5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:17.149711 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1186/2333] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:17 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:17.160089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8734ab-52f9-444d-b09e-c70fcb76a389 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:17.161758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0c8734ab-52f9-444d-b09e-c70fcb76a389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:17.218626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8734ab-52f9-444d-b09e-c70fcb76a389 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:17.222391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8c490-fc76-46eb-ae29-b468c6c73e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:17.223080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8c490-fc76-46eb-ae29-b468c6c73e5a service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:17.223370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8c490-fc76-46eb-ae29-b468c6c73e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:17.223652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8c490-fc76-46eb-ae29-b468c6c73e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:17.232659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8c490-fc76-46eb-ae29-b468c6c73e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:17.234079 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8c490-fc76-46eb-ae29-b468c6c73e5a service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:17.243986 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1148/2334] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:17 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:17.306423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e26035-a2a7-4f5d-a759-b3a157bdda5f None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:17.367917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e26035-a2a7-4f5d-a759-b3a157bdda5f None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:17.372587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:17.373452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:17.373737 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:17.374018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] PATH_INFO: `/v3/users/fd5d1c48c1834c44af1100147772c657` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:17.375254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5d1c48c1834c44af1100147772c657)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:17.377233 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:17.424398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5d1c48c1834c44af1100147772c657'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:17.436551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5d1c48c1834c44af1100147772c657'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:17.437090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5d1c48c1834c44af1100147772c657'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:17.443937 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5d1c48c1834c44af1100147772c657'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:17.445203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5d1c48c1834c44af1100147772c657'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:17.458748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1187/2335] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:17 2021] DELETE /identity/v3/users/fd5d1c48c1834c44af1100147772c657 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:17.463410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fbce0-50c5-4728-b475-1dea44259349 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:17.463876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fbce0-50c5-4728-b475-1dea44259349 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:17.463990 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fbce0-50c5-4728-b475-1dea44259349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:17.482349 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-613fbce0-50c5-4728-b475-1dea44259349 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:17.485745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-613fbce0-50c5-4728-b475-1dea44259349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:17.548095 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1149/2336] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:17.558759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:17.560275 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:17.623942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2becf7f-4ab5-4538-90f7-3aa1909273a6 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:17.629131 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b15c-6981-4b3c-9aa7-cb661575e029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:17.629788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b15c-6981-4b3c-9aa7-cb661575e029 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:17.630074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b15c-6981-4b3c-9aa7-cb661575e029 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:17.630351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b15c-6981-4b3c-9aa7-cb661575e029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:17.642870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8b15c-6981-4b3c-9aa7-cb661575e029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:17.642870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8b15c-6981-4b3c-9aa7-cb661575e029 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:17.652768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1188/2337] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:17.997543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fbce0-50c5-4728-b475-1dea44259349 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:17.999506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-613fbce0-50c5-4728-b475-1dea44259349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:18.011731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fbce0-50c5-4728-b475-1dea44259349 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:18.023277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:18.024324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:18.024865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:18.025358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] PATH_INFO: `/v3/projects/ba9eac01c6b84edf909a4b04d16d6aef` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:18.027694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9eac01c6b84edf909a4b04d16d6aef)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:18.030369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:18.132386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9eac01c6b84edf909a4b04d16d6aef', 'request_id': 'req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:18.144825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9eac01c6b84edf909a4b04d16d6aef', 'request_id': 'req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:18.164707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9eac01c6b84edf909a4b04d16d6aef', 'request_id': 'req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:18.197891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] The token cache is being invalidate because project ba9eac01c6b84edf909a4b04d16d6aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:18.198025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:18.198697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:18.203898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1150/2338] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:17 2021] DELETE /identity/v3/projects/ba9eac01c6b84edf909a4b04d16d6aef => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:18.204705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b15c-6981-4b3c-9aa7-cb661575e029 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:18.220090 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b15c-6981-4b3c-9aa7-cb661575e029 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:18.314265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:18.315887 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:18.316370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:18.317193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] PATH_INFO: `/v3/users/f302e12c6683479eb12d22240cf4bfd2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:18.318460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f302e12c6683479eb12d22240cf4bfd2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:18.321308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:18.383444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f302e12c6683479eb12d22240cf4bfd2'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:18.395615 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f302e12c6683479eb12d22240cf4bfd2'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:18.396398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f302e12c6683479eb12d22240cf4bfd2'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:18.404491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f302e12c6683479eb12d22240cf4bfd2'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:18.405249 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f302e12c6683479eb12d22240cf4bfd2'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:18.431068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1189/2339] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:18 2021] DELETE /identity/v3/users/f302e12c6683479eb12d22240cf4bfd2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:18.801319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:18.806074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:18.894180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:18.897504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:18.938927 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bf11b-21be-4ad8-bbb7-0aaabb4370fb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:18.984012 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a247d-396b-4185-83ea-7d339dc63144 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:18.991470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:18.992479 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:18.992919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:18.993244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] PATH_INFO: `/v3/projects/ef2099d9ceef4ad6bf73b8414172740f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:18.995039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2099d9ceef4ad6bf73b8414172740f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:18.998030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:19.009494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1c081-c131-4608-bd80-e0917ffb8714 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b49222a8e4474bbe14019418ec8aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:19.010164 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c081-c131-4608-bd80-e0917ffb8714 service placement] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.011389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c081-c131-4608-bd80-e0917ffb8714 service placement] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.015313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c081-c131-4608-bd80-e0917ffb8714 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.017689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-43e1c081-c131-4608-bd80-e0917ffb8714 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:19.035351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1c081-c131-4608-bd80-e0917ffb8714 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:19.037187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1c081-c131-4608-bd80-e0917ffb8714 service placement] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:19.051274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1151/2340] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:19.103898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2099d9ceef4ad6bf73b8414172740f', 'request_id': 'req-87ad0dec-1c12-4de3-b1c6-32fe6da48617'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:19.111055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2099d9ceef4ad6bf73b8414172740f', 'request_id': 'req-87ad0dec-1c12-4de3-b1c6-32fe6da48617'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:19.117538 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2099d9ceef4ad6bf73b8414172740f', 'request_id': 'req-87ad0dec-1c12-4de3-b1c6-32fe6da48617'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:19.135873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] The token cache is being invalidate because project ef2099d9ceef4ad6bf73b8414172740f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:19.136194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:19.136889 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-87ad0dec-1c12-4de3-b1c6-32fe6da48617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:19.139201 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1190/2341] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:18 2021] DELETE /identity/v3/projects/ef2099d9ceef4ad6bf73b8414172740f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:19.144950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0dd18-49b2-4b5d-b9a8-ee8156780d94 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.145241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0dd18-49b2-4b5d-b9a8-ee8156780d94 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.145537 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0dd18-49b2-4b5d-b9a8-ee8156780d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.180767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-62f0dd18-49b2-4b5d-b9a8-ee8156780d94 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:19.182026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-62f0dd18-49b2-4b5d-b9a8-ee8156780d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:19.246809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1152/2342] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:19.254575 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c21c6-0d35-42de-81ca-56304824370e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.255091 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c21c6-0d35-42de-81ca-56304824370e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.255189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c21c6-0d35-42de-81ca-56304824370e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.274489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d27c21c6-0d35-42de-81ca-56304824370e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:19.275649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d27c21c6-0d35-42de-81ca-56304824370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:19.283451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1191/2343] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:19.287754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0dd18-49b2-4b5d-b9a8-ee8156780d94 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:19.297923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0dd18-49b2-4b5d-b9a8-ee8156780d94 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:19.302581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa749d-5473-4544-a17d-7488223250a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:19.303366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa749d-5473-4544-a17d-7488223250a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.304298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa749d-5473-4544-a17d-7488223250a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.304651 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa749d-5473-4544-a17d-7488223250a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.305390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa749d-5473-4544-a17d-7488223250a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:30:19.305703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa749d-5473-4544-a17d-7488223250a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:19.307334 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa749d-5473-4544-a17d-7488223250a5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:19.322413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1153/2344] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:30:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:30:19.323703 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c21c6-0d35-42de-81ca-56304824370e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:19.333945 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c21c6-0d35-42de-81ca-56304824370e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:19.344651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5c9ba-41a1-4c21-a13c-c1554e437747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:19.345489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5c9ba-41a1-4c21-a13c-c1554e437747 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.345847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5c9ba-41a1-4c21-a13c-c1554e437747 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.346197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5c9ba-41a1-4c21-a13c-c1554e437747 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.347183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5c9ba-41a1-4c21-a13c-c1554e437747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:19.355467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5c9ba-41a1-4c21-a13c-c1554e437747 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:19.395166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1192/2345] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:19 2021] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:19.399579 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa749d-5473-4544-a17d-7488223250a5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:19.416112 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa749d-5473-4544-a17d-7488223250a5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:19.501911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2fa9-f915-4878-bb51-17f9c13e6318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:19.502582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2fa9-f915-4878-bb51-17f9c13e6318 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.503323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2fa9-f915-4878-bb51-17f9c13e6318 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.503709 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2fa9-f915-4878-bb51-17f9c13e6318 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.504306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c2fa9-f915-4878-bb51-17f9c13e6318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:19.506705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c2fa9-f915-4878-bb51-17f9c13e6318 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:19.530851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1154/2346] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:19 2021] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:30:19.535315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5c9ba-41a1-4c21-a13c-c1554e437747 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:19.547552 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5c9ba-41a1-4c21-a13c-c1554e437747 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:19.555285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ea865-a0eb-4046-a656-facfc5bd4f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:19.556042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ea865-a0eb-4046-a656-facfc5bd4f2a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.556332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ea865-a0eb-4046-a656-facfc5bd4f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.556684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ea865-a0eb-4046-a656-facfc5bd4f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.557417 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ea865-a0eb-4046-a656-facfc5bd4f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:19.559058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ea865-a0eb-4046-a656-facfc5bd4f2a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:19.578958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1193/2347] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:19 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:19.580567 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2fa9-f915-4878-bb51-17f9c13e6318 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:19.591672 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2fa9-f915-4878-bb51-17f9c13e6318 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:19.596481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df23707-f11a-4ff6-b00b-61ebe70c2fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:19.597320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df23707-f11a-4ff6-b00b-61ebe70c2fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.597608 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df23707-f11a-4ff6-b00b-61ebe70c2fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.597893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df23707-f11a-4ff6-b00b-61ebe70c2fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.598649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df23707-f11a-4ff6-b00b-61ebe70c2fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:19.600295 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df23707-f11a-4ff6-b00b-61ebe70c2fc1 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:19.611340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1155/2348] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:19 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:30:19.615869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ea865-a0eb-4046-a656-facfc5bd4f2a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:19.629066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ea865-a0eb-4046-a656-facfc5bd4f2a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:19.637232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f595b7-f1c9-4ed5-8cf3-faa0cb1f8e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:19.638602 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f595b7-f1c9-4ed5-8cf3-faa0cb1f8e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.638923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f595b7-f1c9-4ed5-8cf3-faa0cb1f8e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.639227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f595b7-f1c9-4ed5-8cf3-faa0cb1f8e43 admin admin] PATH_INFO: `/v3/projects/b44d08bb673a462db0e89a7acd525bf6/users/c76af2ccfedc4a469529573479203d93/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.662336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f595b7-f1c9-4ed5-8cf3-faa0cb1f8e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44d08bb673a462db0e89a7acd525bf6, user_id=c76af2ccfedc4a469529573479203d93, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:19.665753 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f595b7-f1c9-4ed5-8cf3-faa0cb1f8e43 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:19.684180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1194/2349] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:19 2021] PUT /identity/v3/projects/b44d08bb673a462db0e89a7acd525bf6/users/c76af2ccfedc4a469529573479203d93/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:19.695206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768d2b-553f-4e6c-a286-62c9c8ca7ff6 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.695499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768d2b-553f-4e6c-a286-62c9c8ca7ff6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.695778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768d2b-553f-4e6c-a286-62c9c8ca7ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.728342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-99768d2b-553f-4e6c-a286-62c9c8ca7ff6 None None] MFA Rules not processed for user `c76af2ccfedc4a469529573479203d93`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:19.729808 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-99768d2b-553f-4e6c-a286-62c9c8ca7ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:19.802324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1156/2350] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:19 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:19.806730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f595b7-f1c9-4ed5-8cf3-faa0cb1f8e43 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:19.867786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f595b7-f1c9-4ed5-8cf3-faa0cb1f8e43 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:19.872587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0377093-7db3-4887-9083-8e9eb6e9604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:19.873373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0377093-7db3-4887-9083-8e9eb6e9604e admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.873682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0377093-7db3-4887-9083-8e9eb6e9604e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.873964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0377093-7db3-4887-9083-8e9eb6e9604e admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.874660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0377093-7db3-4887-9083-8e9eb6e9604e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:19.876972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0377093-7db3-4887-9083-8e9eb6e9604e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:19.906750 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1195/2351] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:19 2021] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:30:19.909769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768d2b-553f-4e6c-a286-62c9c8ca7ff6 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:19.921876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768d2b-553f-4e6c-a286-62c9c8ca7ff6 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:19.987397 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea85c19-8a85-46c0-8396-8b38be1b1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:19.989131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea85c19-8a85-46c0-8396-8b38be1b1e7a admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:19.989492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea85c19-8a85-46c0-8396-8b38be1b1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:19.989840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea85c19-8a85-46c0-8396-8b38be1b1e7a admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:19.990615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea85c19-8a85-46c0-8396-8b38be1b1e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:19.992673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea85c19-8a85-46c0-8396-8b38be1b1e7a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:20.018867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1157/2352] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:19 2021] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:20.023086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0377093-7db3-4887-9083-8e9eb6e9604e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:20.035314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0377093-7db3-4887-9083-8e9eb6e9604e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:20.042258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47300084-e111-4066-af87-1d7e95d2f149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:20.043863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47300084-e111-4066-af87-1d7e95d2f149 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:20.044366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47300084-e111-4066-af87-1d7e95d2f149 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:20.045144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47300084-e111-4066-af87-1d7e95d2f149 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:20.046120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47300084-e111-4066-af87-1d7e95d2f149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:20.048018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47300084-e111-4066-af87-1d7e95d2f149 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:20.072438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1196/2353] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:20 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:20.076596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea85c19-8a85-46c0-8396-8b38be1b1e7a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:20.088284 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea85c19-8a85-46c0-8396-8b38be1b1e7a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:20.093665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aaa59-8ffb-450f-9c3d-e569c87ee263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:20.094647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aaa59-8ffb-450f-9c3d-e569c87ee263 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:20.095041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aaa59-8ffb-450f-9c3d-e569c87ee263 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:20.095399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aaa59-8ffb-450f-9c3d-e569c87ee263 admin admin] PATH_INFO: `/v3/projects/5e0f251bbaa64b3bac71b6781417673e/users/7b8d4a0f4dde4446b4efcca44aa4ca3a/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:20.115698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aaa59-8ffb-450f-9c3d-e569c87ee263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0f251bbaa64b3bac71b6781417673e, user_id=7b8d4a0f4dde4446b4efcca44aa4ca3a, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:20.118727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aaa59-8ffb-450f-9c3d-e569c87ee263 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:20.134881 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1158/2354] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:20 2021] PUT /identity/v3/projects/5e0f251bbaa64b3bac71b6781417673e/users/7b8d4a0f4dde4446b4efcca44aa4ca3a/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:20.138912 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47300084-e111-4066-af87-1d7e95d2f149 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:20.149661 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47300084-e111-4066-af87-1d7e95d2f149 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:20.222316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b7fbd-6139-44a7-ba94-9e6812e441e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:20.223118 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b7fbd-6139-44a7-ba94-9e6812e441e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:20.223433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b7fbd-6139-44a7-ba94-9e6812e441e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:20.223769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b7fbd-6139-44a7-ba94-9e6812e441e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:20.224505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b7fbd-6139-44a7-ba94-9e6812e441e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:20.226775 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b7fbd-6139-44a7-ba94-9e6812e441e2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:20.240406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1197/2355] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:20 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:20.244870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aaa59-8ffb-450f-9c3d-e569c87ee263 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:20.260027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aaa59-8ffb-450f-9c3d-e569c87ee263 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:20.266183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d6087-de90-4e72-97b6-fc12b3fc8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:20.266987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d6087-de90-4e72-97b6-fc12b3fc8435 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:20.268062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d6087-de90-4e72-97b6-fc12b3fc8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:20.268342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d6087-de90-4e72-97b6-fc12b3fc8435 admin admin] PATH_INFO: `/v3/projects/5e0f251bbaa64b3bac71b6781417673e/users/7b8d4a0f4dde4446b4efcca44aa4ca3a/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:20.270606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d6087-de90-4e72-97b6-fc12b3fc8435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0f251bbaa64b3bac71b6781417673e, user_id=7b8d4a0f4dde4446b4efcca44aa4ca3a, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:20.274658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d6087-de90-4e72-97b6-fc12b3fc8435 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:20.317502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1159/2356] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:20 2021] PUT /identity/v3/projects/5e0f251bbaa64b3bac71b6781417673e/users/7b8d4a0f4dde4446b4efcca44aa4ca3a/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:20.320697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8ae0e-8db5-4c0b-86e0-af49f0af01eb None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:20.321227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8ae0e-8db5-4c0b-86e0-af49f0af01eb None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:20.321353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8ae0e-8db5-4c0b-86e0-af49f0af01eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:20.370322 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-06d8ae0e-8db5-4c0b-86e0-af49f0af01eb None None] MFA Rules not processed for user `7b8d4a0f4dde4446b4efcca44aa4ca3a`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:20.371922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-06d8ae0e-8db5-4c0b-86e0-af49f0af01eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:20.580228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c866dd-5f28-454d-8e79-72ea9e97840e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:20.580523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c866dd-5f28-454d-8e79-72ea9e97840e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:20.580807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c866dd-5f28-454d-8e79-72ea9e97840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:20.582625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1198/2357] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:20 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:20.600094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8ae0e-8db5-4c0b-86e0-af49f0af01eb None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:20.604272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-06d8ae0e-8db5-4c0b-86e0-af49f0af01eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:20.652100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a0c866dd-5f28-454d-8e79-72ea9e97840e None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:20.653663 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a0c866dd-5f28-454d-8e79-72ea9e97840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:20.683633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8ae0e-8db5-4c0b-86e0-af49f0af01eb None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:20.687689 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02e8fd-741a-40ba-9235-34280988d6df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:20.688356 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02e8fd-741a-40ba-9235-34280988d6df service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:20.688961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02e8fd-741a-40ba-9235-34280988d6df service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:20.688961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02e8fd-741a-40ba-9235-34280988d6df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:20.700841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02e8fd-741a-40ba-9235-34280988d6df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:20.703423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02e8fd-741a-40ba-9235-34280988d6df service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:20.733385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1199/2358] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:20 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:30:20.734001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1160/2359] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:30:20 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:20.747136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02e8fd-741a-40ba-9235-34280988d6df service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:20.748584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ff02e8fd-741a-40ba-9235-34280988d6df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:20.783039 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c866dd-5f28-454d-8e79-72ea9e97840e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:20.784505 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a0c866dd-5f28-454d-8e79-72ea9e97840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:20.802764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c866dd-5f28-454d-8e79-72ea9e97840e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:20.807697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada8789-05a4-49c8-8a6f-4be1500a65a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:20.808422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada8789-05a4-49c8-8a6f-4be1500a65a7 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:20.808725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada8789-05a4-49c8-8a6f-4be1500a65a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:20.808991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada8789-05a4-49c8-8a6f-4be1500a65a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:20.829600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02e8fd-741a-40ba-9235-34280988d6df service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:20.836664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09011b46-31fd-44b3-b815-a46e72582cc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:20.837700 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09011b46-31fd-44b3-b815-a46e72582cc2 service swift] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:20.838448 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09011b46-31fd-44b3-b815-a46e72582cc2 service swift] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:20.838955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09011b46-31fd-44b3-b815-a46e72582cc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:20.848973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09011b46-31fd-44b3-b815-a46e72582cc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:20.850647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09011b46-31fd-44b3-b815-a46e72582cc2 service swift] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:20.858793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1200/2360] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:30:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:30:20.868184 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada8789-05a4-49c8-8a6f-4be1500a65a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:20.869657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada8789-05a4-49c8-8a6f-4be1500a65a7 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:20.879248 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1161/2361] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:20 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:30:21.012796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09011b46-31fd-44b3-b815-a46e72582cc2 service swift] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:21.082657 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09011b46-31fd-44b3-b815-a46e72582cc2 service swift] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:21.087663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:21.088548 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:21.088829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:21.089104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] PATH_INFO: `/v3/users/c76af2ccfedc4a469529573479203d93` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:21.090528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76af2ccfedc4a469529573479203d93)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:21.092477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:21.141028 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76af2ccfedc4a469529573479203d93'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.154007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76af2ccfedc4a469529573479203d93'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.154786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76af2ccfedc4a469529573479203d93'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.164198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76af2ccfedc4a469529573479203d93'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.165177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76af2ccfedc4a469529573479203d93'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.184208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1201/2362] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:21 2021] DELETE /identity/v3/users/c76af2ccfedc4a469529573479203d93 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:21.188444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8745-1b33-42b5-b3a3-b671585c3c01 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:21.188740 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8745-1b33-42b5-b3a3-b671585c3c01 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:21.189023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8745-1b33-42b5-b3a3-b671585c3c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:21.207858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-6f7c8745-1b33-42b5-b3a3-b671585c3c01 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:21.208945 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6f7c8745-1b33-42b5-b3a3-b671585c3c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:21.280346 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1162/2363] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:21.290724 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:21.292166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:21.353595 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913c142-6228-444c-94b8-d258bb856735 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:21.357376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb47d4-4377-41a9-a818-92e76b5e38cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:21.358025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb47d4-4377-41a9-a818-92e76b5e38cd service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:21.358314 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb47d4-4377-41a9-a818-92e76b5e38cd service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:21.358592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb47d4-4377-41a9-a818-92e76b5e38cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:21.368819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb47d4-4377-41a9-a818-92e76b5e38cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:21.370251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb47d4-4377-41a9-a818-92e76b5e38cd service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:21.380331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1202/2364] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:21.526027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00183fa9-a6c6-4b66-9fcb-e9992665a1c3 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:21.526322 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00183fa9-a6c6-4b66-9fcb-e9992665a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:21.526607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00183fa9-a6c6-4b66-9fcb-e9992665a1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:21.545982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-00183fa9-a6c6-4b66-9fcb-e9992665a1c3 None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:21.547424 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-00183fa9-a6c6-4b66-9fcb-e9992665a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:21.606484 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1163/2365] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:30:21 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:21.620189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb47d4-4377-41a9-a818-92e76b5e38cd service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:21.621586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-76cb47d4-4377-41a9-a818-92e76b5e38cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:21.684826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00183fa9-a6c6-4b66-9fcb-e9992665a1c3 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:21.686225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-00183fa9-a6c6-4b66-9fcb-e9992665a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:21.696920 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb47d4-4377-41a9-a818-92e76b5e38cd service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:21.703115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4be81-1c04-4db8-b57f-58ea702dde6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:21.703776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4be81-1c04-4db8-b57f-58ea702dde6f service swift] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:21.704062 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4be81-1c04-4db8-b57f-58ea702dde6f service swift] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:21.704342 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4be81-1c04-4db8-b57f-58ea702dde6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:21.705528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00183fa9-a6c6-4b66-9fcb-e9992665a1c3 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:21.711301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:21.711843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:21.712185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:21.712526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] PATH_INFO: `/v3/users/52b90ff9898f4cf2bb661469bbfd328a` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:21.713868 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b90ff9898f4cf2bb661469bbfd328a)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:21.714240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4be81-1c04-4db8-b57f-58ea702dde6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:21.715947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4be81-1c04-4db8-b57f-58ea702dde6f service swift] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:21.716073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:21.729000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1203/2366] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:30:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 01:30:21.747221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4be81-1c04-4db8-b57f-58ea702dde6f service swift] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:21.748984 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-76b4be81-1c04-4db8-b57f-58ea702dde6f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:21.771307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4be81-1c04-4db8-b57f-58ea702dde6f service swift] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:21.777845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:21.778778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:21.779033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:21.779291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] PATH_INFO: `/v3/projects/b44d08bb673a462db0e89a7acd525bf6` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:21.780513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44d08bb673a462db0e89a7acd525bf6)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:21.783187 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:21.801572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b90ff9898f4cf2bb661469bbfd328a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.816224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b90ff9898f4cf2bb661469bbfd328a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.817060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b90ff9898f4cf2bb661469bbfd328a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.818580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b90ff9898f4cf2bb661469bbfd328a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.831999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-a7b2df10-bdf9-4282-be52-77bc81e97999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b90ff9898f4cf2bb661469bbfd328a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.860727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1164/2367] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:21 2021] DELETE /identity/v3/users/52b90ff9898f4cf2bb661469bbfd328a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:21.860941 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44d08bb673a462db0e89a7acd525bf6', 'request_id': 'req-777c7e08-fbb4-4449-9841-8adfddcf7779'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.865485 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757bebf-dce8-40a9-9972-3b501663b4ff None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:21.865929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757bebf-dce8-40a9-9972-3b501663b4ff None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:21.866219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757bebf-dce8-40a9-9972-3b501663b4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:21.868816 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44d08bb673a462db0e89a7acd525bf6', 'request_id': 'req-777c7e08-fbb4-4449-9841-8adfddcf7779'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.882375 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44d08bb673a462db0e89a7acd525bf6', 'request_id': 'req-777c7e08-fbb4-4449-9841-8adfddcf7779'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.894628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-b757bebf-dce8-40a9-9972-3b501663b4ff None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:21.896500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b757bebf-dce8-40a9-9972-3b501663b4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:21.911407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] The token cache is being invalidate because project b44d08bb673a462db0e89a7acd525bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:21.911407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.912108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:21.917739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1204/2368] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:21 2021] DELETE /identity/v3/projects/b44d08bb673a462db0e89a7acd525bf6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:21.918490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:21.920632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:21.994333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1165/2369] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:21.995736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757bebf-dce8-40a9-9972-3b501663b4ff None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:21.997135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b757bebf-dce8-40a9-9972-3b501663b4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:22.010967 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c7e08-fbb4-4449-9841-8adfddcf7779 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:22.016564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:22.017953 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:22.018445 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:22.019126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] PATH_INFO: `/v3/users/7b8d4a0f4dde4446b4efcca44aa4ca3a` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:22.020607 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8d4a0f4dde4446b4efcca44aa4ca3a)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:22.024840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:22.077808 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757bebf-dce8-40a9-9972-3b501663b4ff None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:22.082612 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2097da5-8bcd-4258-b6a3-b01f1260c457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:22.083334 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2097da5-8bcd-4258-b6a3-b01f1260c457 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:22.083622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2097da5-8bcd-4258-b6a3-b01f1260c457 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:22.083894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2097da5-8bcd-4258-b6a3-b01f1260c457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:22.085681 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8d4a0f4dde4446b4efcca44aa4ca3a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.094161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2097da5-8bcd-4258-b6a3-b01f1260c457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:22.095706 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2097da5-8bcd-4258-b6a3-b01f1260c457 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:22.098982 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8d4a0f4dde4446b4efcca44aa4ca3a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.099730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8d4a0f4dde4446b4efcca44aa4ca3a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.106478 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1166/2370] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:22.107619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8d4a0f4dde4446b4efcca44aa4ca3a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.108363 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8d4a0f4dde4446b4efcca44aa4ca3a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.126597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1205/2371] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:21 2021] DELETE /identity/v3/users/7b8d4a0f4dde4446b4efcca44aa4ca3a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:22.163509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843c27-3a81-4049-9015-65ecd2c1fa2d None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:22.163876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843c27-3a81-4049-9015-65ecd2c1fa2d None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:22.164167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843c27-3a81-4049-9015-65ecd2c1fa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:22.184370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-66843c27-3a81-4049-9015-65ecd2c1fa2d None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:22.185596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-66843c27-3a81-4049-9015-65ecd2c1fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:22.254932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1167/2372] 10.222.0.23 () {58 vars in 968 bytes} [Wed Aug 25 01:30:22 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:22.269803 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:22.271437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:22.351446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82cfd-d0f4-4c42-ab2b-8c860b290697 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:22.358166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e215e-2503-45e5-9cb0-b4bdd2d78a68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:22.359017 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e215e-2503-45e5-9cb0-b4bdd2d78a68 service swift] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:22.359300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e215e-2503-45e5-9cb0-b4bdd2d78a68 service swift] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:22.359577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e215e-2503-45e5-9cb0-b4bdd2d78a68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:22.370156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e215e-2503-45e5-9cb0-b4bdd2d78a68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:22.371721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e215e-2503-45e5-9cb0-b4bdd2d78a68 service swift] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:22.380104 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1206/2373] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:30:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:30:22.620150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843c27-3a81-4049-9015-65ecd2c1fa2d None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:22.622051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-66843c27-3a81-4049-9015-65ecd2c1fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:22.723938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843c27-3a81-4049-9015-65ecd2c1fa2d None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:22.742951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:22.745880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:22.746352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:22.746760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] PATH_INFO: `/v3/projects/c6f141f452f148898f2cbbf134e41a6d` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:22.748405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f141f452f148898f2cbbf134e41a6d)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:22.750600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:22.763778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e215e-2503-45e5-9cb0-b4bdd2d78a68 service swift] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:22.765868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ba1e215e-2503-45e5-9cb0-b4bdd2d78a68 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:22.804084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e215e-2503-45e5-9cb0-b4bdd2d78a68 service swift] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:22.821397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:22.822245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f141f452f148898f2cbbf134e41a6d', 'request_id': 'req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.822751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:22.822751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:22.822948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] PATH_INFO: `/v3/projects/5e0f251bbaa64b3bac71b6781417673e` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:22.824019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0f251bbaa64b3bac71b6781417673e)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:22.825987 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:22.831928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f141f452f148898f2cbbf134e41a6d', 'request_id': 'req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.842263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f141f452f148898f2cbbf134e41a6d', 'request_id': 'req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.864153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] The token cache is being invalidate because project c6f141f452f148898f2cbbf134e41a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:22.864532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.865233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ca9261ee-0c4f-46ab-a19b-1899f10f4d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.867358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1168/2374] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:22 2021] DELETE /identity/v3/projects/c6f141f452f148898f2cbbf134e41a6d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:22.873396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35517dda-a714-44ec-8663-5002a568019e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:22.873797 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35517dda-a714-44ec-8663-5002a568019e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:22.874361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35517dda-a714-44ec-8663-5002a568019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:22.889127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0f251bbaa64b3bac71b6781417673e', 'request_id': 'req-200d817d-7f39-45f9-88b8-58c6ccf1a195'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.899282 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0f251bbaa64b3bac71b6781417673e', 'request_id': 'req-200d817d-7f39-45f9-88b8-58c6ccf1a195'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.900415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-35517dda-a714-44ec-8663-5002a568019e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:22.901637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-35517dda-a714-44ec-8663-5002a568019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:22.905366 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0f251bbaa64b3bac71b6781417673e', 'request_id': 'req-200d817d-7f39-45f9-88b8-58c6ccf1a195'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.921189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] The token cache is being invalidate because project 5e0f251bbaa64b3bac71b6781417673e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:22.921495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.922151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-200d817d-7f39-45f9-88b8-58c6ccf1a195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:22.924344 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1207/2375] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:22 2021] DELETE /identity/v3/projects/5e0f251bbaa64b3bac71b6781417673e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:22.930218 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10816f-b94c-4482-a71f-04b20d51e363 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:22.930582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10816f-b94c-4482-a71f-04b20d51e363 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:22.930956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10816f-b94c-4482-a71f-04b20d51e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:22.951601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-5f10816f-b94c-4482-a71f-04b20d51e363 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:22.953428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5f10816f-b94c-4482-a71f-04b20d51e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:23.023304 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1169/2376] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:23.031857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849820e0-6ecd-46bc-b438-1d959f6c2893 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.032156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849820e0-6ecd-46bc-b438-1d959f6c2893 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.032419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849820e0-6ecd-46bc-b438-1d959f6c2893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.049153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1208/2377] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:23.054080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-849820e0-6ecd-46bc-b438-1d959f6c2893 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:23.055515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-849820e0-6ecd-46bc-b438-1d959f6c2893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:23.056834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc79ed-ed2f-44e0-b863-68d0fb115144 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.057126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc79ed-ed2f-44e0-b863-68d0fb115144 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.057403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc79ed-ed2f-44e0-b863-68d0fb115144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.068851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1170/2378] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:23.070535 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849820e0-6ecd-46bc-b438-1d959f6c2893 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.082408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-96bc79ed-ed2f-44e0-b863-68d0fb115144 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:23.082408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-96bc79ed-ed2f-44e0-b863-68d0fb115144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:23.082779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849820e0-6ecd-46bc-b438-1d959f6c2893 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.090971 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1209/2379] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:23.094080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5c53f-c338-4593-b436-20745d0f3337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.094517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5c53f-c338-4593-b436-20745d0f3337 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.094839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5c53f-c338-4593-b436-20745d0f3337 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.095121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5c53f-c338-4593-b436-20745d0f3337 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.095865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5c53f-c338-4593-b436-20745d0f3337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:30:23.096036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc79ed-ed2f-44e0-b863-68d0fb115144 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.096175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5c53f-c338-4593-b436-20745d0f3337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.097775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5c53f-c338-4593-b436-20745d0f3337 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.105541 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc79ed-ed2f-44e0-b863-68d0fb115144 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.118453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1171/2380] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:30:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:30:23.119634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5c53f-c338-4593-b436-20745d0f3337 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.120360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda95b6-6efe-40e6-9cae-64d2208e8487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.121078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda95b6-6efe-40e6-9cae-64d2208e8487 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.121361 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda95b6-6efe-40e6-9cae-64d2208e8487 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.121636 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda95b6-6efe-40e6-9cae-64d2208e8487 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.122414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda95b6-6efe-40e6-9cae-64d2208e8487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:30:23.122826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda95b6-6efe-40e6-9cae-64d2208e8487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.124966 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda95b6-6efe-40e6-9cae-64d2208e8487 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.134258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5c53f-c338-4593-b436-20745d0f3337 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.141048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21d126-6aa6-4cd9-844e-6ffe5a8b19b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.141048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21d126-6aa6-4cd9-844e-6ffe5a8b19b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.141595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21d126-6aa6-4cd9-844e-6ffe5a8b19b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.141879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21d126-6aa6-4cd9-844e-6ffe5a8b19b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.143021 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21d126-6aa6-4cd9-844e-6ffe5a8b19b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.143649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1210/2381] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:30:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:30:23.144898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21d126-6aa6-4cd9-844e-6ffe5a8b19b7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.148633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda95b6-6efe-40e6-9cae-64d2208e8487 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.159261 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda95b6-6efe-40e6-9cae-64d2208e8487 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.169796 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa08fd1-24bc-404c-a08a-d0175aab566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.170642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa08fd1-24bc-404c-a08a-d0175aab566a admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.171079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa08fd1-24bc-404c-a08a-d0175aab566a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.171660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa08fd1-24bc-404c-a08a-d0175aab566a admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.172501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa08fd1-24bc-404c-a08a-d0175aab566a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.174664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa08fd1-24bc-404c-a08a-d0175aab566a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.176514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1172/2382] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:23 2021] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:30:23.182475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21d126-6aa6-4cd9-844e-6ffe5a8b19b7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.214108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1211/2383] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:23 2021] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:23.218110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa08fd1-24bc-404c-a08a-d0175aab566a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.269200 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21d126-6aa6-4cd9-844e-6ffe5a8b19b7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.310228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa08fd1-24bc-404c-a08a-d0175aab566a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.325768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81030f6-5ea3-44da-8061-b7e8113e7bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.326459 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81030f6-5ea3-44da-8061-b7e8113e7bba admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.326771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81030f6-5ea3-44da-8061-b7e8113e7bba admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.327049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81030f6-5ea3-44da-8061-b7e8113e7bba admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.327731 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81030f6-5ea3-44da-8061-b7e8113e7bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.331029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81030f6-5ea3-44da-8061-b7e8113e7bba admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.344136 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26871ba-a82d-4f4b-ab10-876b30d36ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.344903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26871ba-a82d-4f4b-ab10-876b30d36ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.345306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26871ba-a82d-4f4b-ab10-876b30d36ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.345837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26871ba-a82d-4f4b-ab10-876b30d36ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.346656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26871ba-a82d-4f4b-ab10-876b30d36ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.348711 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26871ba-a82d-4f4b-ab10-876b30d36ef8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.358951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1212/2384] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:23 2021] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:30:23.363578 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81030f6-5ea3-44da-8061-b7e8113e7bba admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.376044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81030f6-5ea3-44da-8061-b7e8113e7bba admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.380872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1173/2385] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:23 2021] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:30:23.384142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5c19-5a24-4ee4-ab5b-62cfff111a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.384706 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26871ba-a82d-4f4b-ab10-876b30d36ef8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.384997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5c19-5a24-4ee4-ab5b-62cfff111a6a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.385589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5c19-5a24-4ee4-ab5b-62cfff111a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.385879 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5c19-5a24-4ee4-ab5b-62cfff111a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.386607 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e5c19-5a24-4ee4-ab5b-62cfff111a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.388485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e5c19-5a24-4ee4-ab5b-62cfff111a6a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.403001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26871ba-a82d-4f4b-ab10-876b30d36ef8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.405470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1213/2386] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:30:23.409225 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5c19-5a24-4ee4-ab5b-62cfff111a6a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.410172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21870d32-c3eb-4836-b5c3-0960fcfa104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.410874 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870d32-c3eb-4836-b5c3-0960fcfa104c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.411831 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870d32-c3eb-4836-b5c3-0960fcfa104c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.412114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870d32-c3eb-4836-b5c3-0960fcfa104c admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.413398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21870d32-c3eb-4836-b5c3-0960fcfa104c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.415156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21870d32-c3eb-4836-b5c3-0960fcfa104c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.430710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5c19-5a24-4ee4-ab5b-62cfff111a6a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.436861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1174/2387] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:23.440561 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21870d32-c3eb-4836-b5c3-0960fcfa104c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.440938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44382e21-ebb5-4595-a77d-b4afbb8041f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.441618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44382e21-ebb5-4595-a77d-b4afbb8041f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.441902 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44382e21-ebb5-4595-a77d-b4afbb8041f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.442202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44382e21-ebb5-4595-a77d-b4afbb8041f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.443023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44382e21-ebb5-4595-a77d-b4afbb8041f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.444684 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44382e21-ebb5-4595-a77d-b4afbb8041f4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.454186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21870d32-c3eb-4836-b5c3-0960fcfa104c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.457831 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1214/2388] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:23.462047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d41bca-e230-41e1-a1ee-b6dbd922de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.462047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d41bca-e230-41e1-a1ee-b6dbd922de38 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.462897 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d41bca-e230-41e1-a1ee-b6dbd922de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.463213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44382e21-ebb5-4595-a77d-b4afbb8041f4 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.464968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d41bca-e230-41e1-a1ee-b6dbd922de38 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.466114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d41bca-e230-41e1-a1ee-b6dbd922de38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.467898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d41bca-e230-41e1-a1ee-b6dbd922de38 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.474523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44382e21-ebb5-4595-a77d-b4afbb8041f4 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.482559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1175/2389] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:30:23.486740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a2acd-f282-46da-bc15-0bc7d1550791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.486740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a2acd-f282-46da-bc15-0bc7d1550791 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.486740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a2acd-f282-46da-bc15-0bc7d1550791 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.486740 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a2acd-f282-46da-bc15-0bc7d1550791 admin admin] PATH_INFO: `/v3/projects/b9b94fef3ce040638c04f85818ae7103/users/ce7e07b4295646208961fda4c164e984/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.489122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d41bca-e230-41e1-a1ee-b6dbd922de38 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.501573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d41bca-e230-41e1-a1ee-b6dbd922de38 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.507116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56672e96-7921-4f4b-bc0e-0e9b900c20ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.508391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56672e96-7921-4f4b-bc0e-0e9b900c20ee admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.508727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56672e96-7921-4f4b-bc0e-0e9b900c20ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.509078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56672e96-7921-4f4b-bc0e-0e9b900c20ee admin admin] PATH_INFO: `/v3/projects/85eb91637b4c4d27913fe39797a4d79a/users/394a195e156b49c4b36b989862f8372e/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.518400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a2acd-f282-46da-bc15-0bc7d1550791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b94fef3ce040638c04f85818ae7103, user_id=ce7e07b4295646208961fda4c164e984, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.523177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a2acd-f282-46da-bc15-0bc7d1550791 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.535613 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56672e96-7921-4f4b-bc0e-0e9b900c20ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=85eb91637b4c4d27913fe39797a4d79a, user_id=394a195e156b49c4b36b989862f8372e, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.538911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56672e96-7921-4f4b-bc0e-0e9b900c20ee admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.543270 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1215/2390] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:23 2021] PUT /identity/v3/projects/b9b94fef3ce040638c04f85818ae7103/users/ce7e07b4295646208961fda4c164e984/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:23.554545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21946ea-cb08-44b6-9323-8a67b51271dc None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.555110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21946ea-cb08-44b6-9323-8a67b51271dc None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.555560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21946ea-cb08-44b6-9323-8a67b51271dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.564492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1176/2391] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:23 2021] PUT /identity/v3/projects/85eb91637b4c4d27913fe39797a4d79a/users/394a195e156b49c4b36b989862f8372e/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:23.576023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4cfc6-d409-4aeb-b9bd-ce16c39bf4e2 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.576387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4cfc6-d409-4aeb-b9bd-ce16c39bf4e2 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.576787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4cfc6-d409-4aeb-b9bd-ce16c39bf4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.601147 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a21946ea-cb08-44b6-9323-8a67b51271dc None None] MFA Rules not processed for user `ce7e07b4295646208961fda4c164e984`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:23.602777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a21946ea-cb08-44b6-9323-8a67b51271dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:23.605490 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a1c4cfc6-d409-4aeb-b9bd-ce16c39bf4e2 None None] MFA Rules not processed for user `394a195e156b49c4b36b989862f8372e`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:23.606406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a1c4cfc6-d409-4aeb-b9bd-ce16c39bf4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:23.690221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1177/2392] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:23 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:23.695307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1216/2393] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:23 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:23.700919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4cfc6-d409-4aeb-b9bd-ce16c39bf4e2 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.702820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a1c4cfc6-d409-4aeb-b9bd-ce16c39bf4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:23.789858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4cfc6-d409-4aeb-b9bd-ce16c39bf4e2 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.793242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21946ea-cb08-44b6-9323-8a67b51271dc None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.794265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3ec4-8bcf-4cff-a9ea-2e7b2c0fd5ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.794944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a21946ea-cb08-44b6-9323-8a67b51271dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:23.795060 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3ec4-8bcf-4cff-a9ea-2e7b2c0fd5ec service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.795272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3ec4-8bcf-4cff-a9ea-2e7b2c0fd5ec service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.795551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3ec4-8bcf-4cff-a9ea-2e7b2c0fd5ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.805232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c3ec4-8bcf-4cff-a9ea-2e7b2c0fd5ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.806970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c3ec4-8bcf-4cff-a9ea-2e7b2c0fd5ec service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.807739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21946ea-cb08-44b6-9323-8a67b51271dc None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.811516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231fec7-b963-4260-b36c-b7f8ea405ccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.812432 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231fec7-b963-4260-b36c-b7f8ea405ccf service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.812721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231fec7-b963-4260-b36c-b7f8ea405ccf service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.813003 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231fec7-b963-4260-b36c-b7f8ea405ccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.818030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1178/2394] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:23 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:23.825027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231fec7-b963-4260-b36c-b7f8ea405ccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.825202 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231fec7-b963-4260-b36c-b7f8ea405ccf service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:23.836901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1217/2395] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:23 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:30:23.860628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3ec4-8bcf-4cff-a9ea-2e7b2c0fd5ec service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:23.945841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3ec4-8bcf-4cff-a9ea-2e7b2c0fd5ec service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:23.951181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:23.952050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:23.952328 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:23.952600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] PATH_INFO: `/v3/users/ce7e07b4295646208961fda4c164e984` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:23.953804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7e07b4295646208961fda4c164e984)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:23.955820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:24.023876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7e07b4295646208961fda4c164e984'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.034195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7e07b4295646208961fda4c164e984'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.034989 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7e07b4295646208961fda4c164e984'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.035730 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7e07b4295646208961fda4c164e984'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.045430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7e07b4295646208961fda4c164e984'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.068206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1179/2396] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:23 2021] DELETE /identity/v3/users/ce7e07b4295646208961fda4c164e984 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:24.072870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f24dc-5d62-4d40-be38-9ec972f0441c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:24.073166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f24dc-5d62-4d40-be38-9ec972f0441c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:24.073457 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f24dc-5d62-4d40-be38-9ec972f0441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:24.095812 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-cd4f24dc-5d62-4d40-be38-9ec972f0441c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:24.097234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cd4f24dc-5d62-4d40-be38-9ec972f0441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:24.202178 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1218/2397] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:24.213399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:24.215777 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:24.283220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d5659-5399-40e6-ad45-c6866ff10eb9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:24.287621 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d5fbf-56df-41ef-939b-3b1f431649e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:24.288827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5fbf-56df-41ef-939b-3b1f431649e6 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:24.289174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5fbf-56df-41ef-939b-3b1f431649e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:24.289463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5fbf-56df-41ef-939b-3b1f431649e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:24.299228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d5fbf-56df-41ef-939b-3b1f431649e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:24.300675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d5fbf-56df-41ef-939b-3b1f431649e6 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:24.310771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1180/2398] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:30:24.396059 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f24dc-5d62-4d40-be38-9ec972f0441c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:24.398127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cd4f24dc-5d62-4d40-be38-9ec972f0441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:24.410085 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f24dc-5d62-4d40-be38-9ec972f0441c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:24.413751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e218a5-304d-43c2-bc2a-71520ec90142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:24.414421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e218a5-304d-43c2-bc2a-71520ec90142 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:24.414719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e218a5-304d-43c2-bc2a-71520ec90142 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:24.415008 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e218a5-304d-43c2-bc2a-71520ec90142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:24.416934 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d7e218a5-304d-43c2-bc2a-71520ec90142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:24.499303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e218a5-304d-43c2-bc2a-71520ec90142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:24.500771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e218a5-304d-43c2-bc2a-71520ec90142 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:24.517107 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1219/2399] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:24 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:24.582069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d5fbf-56df-41ef-939b-3b1f431649e6 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:24.583795 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-bd3d5fbf-56df-41ef-939b-3b1f431649e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:24.602034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d5fbf-56df-41ef-939b-3b1f431649e6 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:24.608546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:24.609412 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:24.609691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:24.610080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] PATH_INFO: `/v3/users/0a0482a3d16145ee99796f833a2e6ba9` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:24.611301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0482a3d16145ee99796f833a2e6ba9)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:24.613350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:24.648670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e218a5-304d-43c2-bc2a-71520ec90142 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:24.650237 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d7e218a5-304d-43c2-bc2a-71520ec90142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:24.679444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e218a5-304d-43c2-bc2a-71520ec90142 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:24.684495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:24.685454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:24.685805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:24.686175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] PATH_INFO: `/v3/projects/b9b94fef3ce040638c04f85818ae7103` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:24.687332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b94fef3ce040638c04f85818ae7103)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:24.688018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0482a3d16145ee99796f833a2e6ba9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.691506 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:24.699373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0482a3d16145ee99796f833a2e6ba9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.700870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0482a3d16145ee99796f833a2e6ba9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.701843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0482a3d16145ee99796f833a2e6ba9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.711734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-cfe52c38-c0aa-4f1c-b282-b075ad9bb178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0482a3d16145ee99796f833a2e6ba9'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.737000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1181/2400] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:24 2021] DELETE /identity/v3/users/0a0482a3d16145ee99796f833a2e6ba9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:24.741265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08261ae-b57a-4725-b98c-8938ac4f3365 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:24.741719 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08261ae-b57a-4725-b98c-8938ac4f3365 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:24.742005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08261ae-b57a-4725-b98c-8938ac4f3365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:24.748041 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b94fef3ce040638c04f85818ae7103', 'request_id': 'req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.754534 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b94fef3ce040638c04f85818ae7103', 'request_id': 'req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.761513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d08261ae-b57a-4725-b98c-8938ac4f3365 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:24.762960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d08261ae-b57a-4725-b98c-8938ac4f3365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:24.763466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b94fef3ce040638c04f85818ae7103', 'request_id': 'req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.783749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] The token cache is being invalidate because project b9b94fef3ce040638c04f85818ae7103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:24.784051 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.785164 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-58edf5d5-7ab6-49a6-93ca-2ade77c5e165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:24.787224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1220/2401] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:24 2021] DELETE /identity/v3/projects/b9b94fef3ce040638c04f85818ae7103 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:24.793336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c8ee3-1a23-419d-9e48-0629d1bda6eb None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:24.793634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c8ee3-1a23-419d-9e48-0629d1bda6eb None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:24.793922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c8ee3-1a23-419d-9e48-0629d1bda6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:24.816862 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a41c8ee3-1a23-419d-9e48-0629d1bda6eb None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:24.818108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a41c8ee3-1a23-419d-9e48-0629d1bda6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:24.865395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1182/2402] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:24.879754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08261ae-b57a-4725-b98c-8938ac4f3365 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:24.881410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d08261ae-b57a-4725-b98c-8938ac4f3365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:24.902899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1221/2403] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:24.911812 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4baea1-2e9d-418d-bc86-9be4cfa59c86 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:24.912038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4baea1-2e9d-418d-bc86-9be4cfa59c86 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:24.912476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4baea1-2e9d-418d-bc86-9be4cfa59c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:24.947431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-0f4baea1-2e9d-418d-bc86-9be4cfa59c86 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:24.950938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0f4baea1-2e9d-418d-bc86-9be4cfa59c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:24.961267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1222/2404] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:24.965048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4baea1-2e9d-418d-bc86-9be4cfa59c86 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:24.974114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4baea1-2e9d-418d-bc86-9be4cfa59c86 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:24.983678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08261ae-b57a-4725-b98c-8938ac4f3365 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:24.991698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd941f3-7086-478c-b0a9-3982833d85bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:24.992382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd941f3-7086-478c-b0a9-3982833d85bf service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:24.992671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd941f3-7086-478c-b0a9-3982833d85bf service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:24.992954 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd941f3-7086-478c-b0a9-3982833d85bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:24.994255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68100284-a606-496c-b322-d277ea6a8851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:24.995415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68100284-a606-496c-b322-d277ea6a8851 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:24.995415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68100284-a606-496c-b322-d277ea6a8851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:24.995618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68100284-a606-496c-b322-d277ea6a8851 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:24.996242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68100284-a606-496c-b322-d277ea6a8851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:30:24.996552 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68100284-a606-496c-b322-d277ea6a8851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:24.998188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68100284-a606-496c-b322-d277ea6a8851 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:25.008435 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd941f3-7086-478c-b0a9-3982833d85bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:25.009876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd941f3-7086-478c-b0a9-3982833d85bf service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:25.010018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1223/2405] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:30:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:30:25.014394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68100284-a606-496c-b322-d277ea6a8851 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:25.021451 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1183/2406] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:30:25.024521 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68100284-a606-496c-b322-d277ea6a8851 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:25.029737 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322d9b0-ac65-4927-b55b-2cfe82654e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:25.030401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322d9b0-ac65-4927-b55b-2cfe82654e6f admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:25.030705 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322d9b0-ac65-4927-b55b-2cfe82654e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:25.030988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322d9b0-ac65-4927-b55b-2cfe82654e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:25.031679 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322d9b0-ac65-4927-b55b-2cfe82654e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:25.037098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322d9b0-ac65-4927-b55b-2cfe82654e6f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:25.070179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1224/2407] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:25 2021] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:30:25.074316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd941f3-7086-478c-b0a9-3982833d85bf service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:25.085850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd941f3-7086-478c-b0a9-3982833d85bf service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:25.158024 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d0ee0-6c70-4bc8-9d09-90befafca4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:25.158714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d0ee0-6c70-4bc8-9d09-90befafca4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:25.159056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d0ee0-6c70-4bc8-9d09-90befafca4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:25.159401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d0ee0-6c70-4bc8-9d09-90befafca4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:25.160318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d0ee0-6c70-4bc8-9d09-90befafca4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:25.162352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d0ee0-6c70-4bc8-9d09-90befafca4e0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:25.185640 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1184/2408] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:25 2021] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:25.190473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322d9b0-ac65-4927-b55b-2cfe82654e6f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:25.202015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322d9b0-ac65-4927-b55b-2cfe82654e6f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:25.209332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e434db2-41b7-4bf3-bc57-4257d777c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:25.210991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434db2-41b7-4bf3-bc57-4257d777c600 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:25.211351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434db2-41b7-4bf3-bc57-4257d777c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:25.211702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434db2-41b7-4bf3-bc57-4257d777c600 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:25.212532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e434db2-41b7-4bf3-bc57-4257d777c600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:25.216476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e434db2-41b7-4bf3-bc57-4257d777c600 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:25.217811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d0ee0-6c70-4bc8-9d09-90befafca4e0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:25.219725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-793d0ee0-6c70-4bc8-9d09-90befafca4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:25.228480 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1225/2409] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:25 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:25.233744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d0ee0-6c70-4bc8-9d09-90befafca4e0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:25.233886 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e434db2-41b7-4bf3-bc57-4257d777c600 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:25.258366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:25.259769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e434db2-41b7-4bf3-bc57-4257d777c600 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:25.259889 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:25.260144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:25.261131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] PATH_INFO: `/v3/projects/af7953fd9085478886e801134807fdaa` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:25.262715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7953fd9085478886e801134807fdaa)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:25.267899 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:25.268607 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecd5a0-b342-40e4-a3ff-b38ab75e6c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:25.269337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecd5a0-b342-40e4-a3ff-b38ab75e6c2e admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:25.269668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecd5a0-b342-40e4-a3ff-b38ab75e6c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:25.269949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecd5a0-b342-40e4-a3ff-b38ab75e6c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:25.270670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecd5a0-b342-40e4-a3ff-b38ab75e6c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:25.273409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecd5a0-b342-40e4-a3ff-b38ab75e6c2e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:25.306604 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1226/2410] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:25 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:25.310991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecd5a0-b342-40e4-a3ff-b38ab75e6c2e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:25.324466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecd5a0-b342-40e4-a3ff-b38ab75e6c2e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:25.332330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7953fd9085478886e801134807fdaa', 'request_id': 'req-c0322011-d2fa-437b-8842-970e730af908'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:25.340549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7953fd9085478886e801134807fdaa', 'request_id': 'req-c0322011-d2fa-437b-8842-970e730af908'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:25.348071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7953fd9085478886e801134807fdaa', 'request_id': 'req-c0322011-d2fa-437b-8842-970e730af908'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:25.366491 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] The token cache is being invalidate because project af7953fd9085478886e801134807fdaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:25.367395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:25.368242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c0322011-d2fa-437b-8842-970e730af908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:25.370043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1185/2411] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:25 2021] DELETE /identity/v3/projects/af7953fd9085478886e801134807fdaa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:25.418440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4e7c-bb06-4982-9e60-e0600b147f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:25.420387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4e7c-bb06-4982-9e60-e0600b147f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:25.420817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4e7c-bb06-4982-9e60-e0600b147f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:25.421021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4e7c-bb06-4982-9e60-e0600b147f53 admin admin] PATH_INFO: `/v3/projects/d051fbdc3cba47c38afe9f685d00dee7/users/3a4ea0994c844f32aecee8995d9a9a6a/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:25.445745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac4e7c-bb06-4982-9e60-e0600b147f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d051fbdc3cba47c38afe9f685d00dee7, user_id=3a4ea0994c844f32aecee8995d9a9a6a, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:25.449050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac4e7c-bb06-4982-9e60-e0600b147f53 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:25.490256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1227/2412] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:25 2021] PUT /identity/v3/projects/d051fbdc3cba47c38afe9f685d00dee7/users/3a4ea0994c844f32aecee8995d9a9a6a/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:25.495675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76629ec4-4f25-42c4-aaba-39701c606664 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:25.496022 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76629ec4-4f25-42c4-aaba-39701c606664 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:25.496295 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76629ec4-4f25-42c4-aaba-39701c606664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:25.565641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-76629ec4-4f25-42c4-aaba-39701c606664 None None] MFA Rules not processed for user `3a4ea0994c844f32aecee8995d9a9a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:25.565641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-76629ec4-4f25-42c4-aaba-39701c606664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:25.635582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1186/2413] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:25 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:25.645745 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4e7c-bb06-4982-9e60-e0600b147f53 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:25.647572 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5bac4e7c-bb06-4982-9e60-e0600b147f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:25.709519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4e7c-bb06-4982-9e60-e0600b147f53 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:25.713111 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94587a-147c-4d0a-9019-4029117fe5d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:25.713761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94587a-147c-4d0a-9019-4029117fe5d8 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:25.714047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94587a-147c-4d0a-9019-4029117fe5d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:25.714326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94587a-147c-4d0a-9019-4029117fe5d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:25.726998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94587a-147c-4d0a-9019-4029117fe5d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:25.728451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94587a-147c-4d0a-9019-4029117fe5d8 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:25.737564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1228/2414] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:25 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:33.043898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76629ec4-4f25-42c4-aaba-39701c606664 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:33.045942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-76629ec4-4f25-42c4-aaba-39701c606664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:33.130169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76629ec4-4f25-42c4-aaba-39701c606664 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:33.135027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:33.135965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:33.136299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:33.136573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] PATH_INFO: `/v3/users/3a4ea0994c844f32aecee8995d9a9a6a` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:33.137761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4ea0994c844f32aecee8995d9a9a6a)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:33.139956 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:33.188933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4ea0994c844f32aecee8995d9a9a6a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:33.195534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4ea0994c844f32aecee8995d9a9a6a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:33.196206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4ea0994c844f32aecee8995d9a9a6a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:33.196815 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4ea0994c844f32aecee8995d9a9a6a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:33.204147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4ea0994c844f32aecee8995d9a9a6a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:33.223100 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1187/2415] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:33 2021] DELETE /identity/v3/users/3a4ea0994c844f32aecee8995d9a9a6a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:33.228132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b077-33d7-4af1-88f8-8bb5a376015e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:33.228588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b077-33d7-4af1-88f8-8bb5a376015e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:33.228927 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b077-33d7-4af1-88f8-8bb5a376015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:33.247633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-fa13b077-33d7-4af1-88f8-8bb5a376015e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:33.249135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fa13b077-33d7-4af1-88f8-8bb5a376015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:33.313929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1229/2416] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:33.324605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:33.326038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:33.387540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce33c8-42e8-4f8a-8405-62b039b3578e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:33.391932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196623ea-9017-449b-b840-c99996401c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:33.392742 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196623ea-9017-449b-b840-c99996401c35 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:33.393030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196623ea-9017-449b-b840-c99996401c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:33.393300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196623ea-9017-449b-b840-c99996401c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:33.408085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196623ea-9017-449b-b840-c99996401c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:33.409580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196623ea-9017-449b-b840-c99996401c35 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:33.422760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1188/2417] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:30:33.739501 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b077-33d7-4af1-88f8-8bb5a376015e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:33.745596 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fa13b077-33d7-4af1-88f8-8bb5a376015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:33.759262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b077-33d7-4af1-88f8-8bb5a376015e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:33.764367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:33.765393 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:33.765676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:33.766088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] PATH_INFO: `/v3/projects/d051fbdc3cba47c38afe9f685d00dee7` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:33.767293 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d051fbdc3cba47c38afe9f685d00dee7)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:33.769367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:33.823557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd051fbdc3cba47c38afe9f685d00dee7', 'request_id': 'req-c2503ef7-1410-4b83-849d-02d3487219c7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:33.829695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd051fbdc3cba47c38afe9f685d00dee7', 'request_id': 'req-c2503ef7-1410-4b83-849d-02d3487219c7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:33.835370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd051fbdc3cba47c38afe9f685d00dee7', 'request_id': 'req-c2503ef7-1410-4b83-849d-02d3487219c7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:33.849033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] The token cache is being invalidate because project d051fbdc3cba47c38afe9f685d00dee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:33.849330 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:33.849993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c2503ef7-1410-4b83-849d-02d3487219c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:33.851756 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1230/2418] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:33 2021] DELETE /identity/v3/projects/d051fbdc3cba47c38afe9f685d00dee7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:33.857906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12741c0-29c8-4900-a65e-91a73441627f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:33.858197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12741c0-29c8-4900-a65e-91a73441627f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:33.858566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12741c0-29c8-4900-a65e-91a73441627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:33.877098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-e12741c0-29c8-4900-a65e-91a73441627f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:33.878326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e12741c0-29c8-4900-a65e-91a73441627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:33.943391 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1189/2419] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:30:33.952676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6914dda-b3d1-4b0c-b052-1d40a5258d6d None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:33.952963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6914dda-b3d1-4b0c-b052-1d40a5258d6d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:33.953242 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6914dda-b3d1-4b0c-b052-1d40a5258d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:33.972332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b6914dda-b3d1-4b0c-b052-1d40a5258d6d None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:33.973542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b6914dda-b3d1-4b0c-b052-1d40a5258d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:33.984800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1231/2420] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:33.988496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12741c0-29c8-4900-a65e-91a73441627f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:33.998332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12741c0-29c8-4900-a65e-91a73441627f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.009009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c51e0-c707-4c69-b242-fd4a0cda3fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.009684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c51e0-c707-4c69-b242-fd4a0cda3fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.010050 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c51e0-c707-4c69-b242-fd4a0cda3fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.010247 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c51e0-c707-4c69-b242-fd4a0cda3fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.011036 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c51e0-c707-4c69-b242-fd4a0cda3fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:30:34.011341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c51e0-c707-4c69-b242-fd4a0cda3fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.014833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c51e0-c707-4c69-b242-fd4a0cda3fa3 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.026164 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1190/2421] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:30:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:30:34.030471 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6914dda-b3d1-4b0c-b052-1d40a5258d6d None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.040794 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6914dda-b3d1-4b0c-b052-1d40a5258d6d None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.045667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ee5f-220e-4930-abe7-8ed87dc08003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.046391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ee5f-220e-4930-abe7-8ed87dc08003 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.046604 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ee5f-220e-4930-abe7-8ed87dc08003 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.046994 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ee5f-220e-4930-abe7-8ed87dc08003 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.047622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6ee5f-220e-4930-abe7-8ed87dc08003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.049558 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6ee5f-220e-4930-abe7-8ed87dc08003 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.076060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1232/2422] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:34 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:34.080491 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c51e0-c707-4c69-b242-fd4a0cda3fa3 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.094667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c51e0-c707-4c69-b242-fd4a0cda3fa3 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.157941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbfc71-3016-4d66-a098-fa2aa3e75ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.158643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbfc71-3016-4d66-a098-fa2aa3e75ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.158953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbfc71-3016-4d66-a098-fa2aa3e75ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.159233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbfc71-3016-4d66-a098-fa2aa3e75ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.159957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbfc71-3016-4d66-a098-fa2aa3e75ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.161874 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbfc71-3016-4d66-a098-fa2aa3e75ee6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.183411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1191/2423] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:34 2021] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:30:34.187487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ee5f-220e-4930-abe7-8ed87dc08003 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.198601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ee5f-220e-4930-abe7-8ed87dc08003 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.203441 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe40d-cf5e-4154-ae39-0000ccac1e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.204099 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe40d-cf5e-4154-ae39-0000ccac1e73 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.204384 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe40d-cf5e-4154-ae39-0000ccac1e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.204663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe40d-cf5e-4154-ae39-0000ccac1e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.205389 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efe40d-cf5e-4154-ae39-0000ccac1e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.207060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efe40d-cf5e-4154-ae39-0000ccac1e73 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.218213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1233/2424] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:34.223845 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbfc71-3016-4d66-a098-fa2aa3e75ee6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.233779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbfc71-3016-4d66-a098-fa2aa3e75ee6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.238510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7fbe4-54b6-44f2-bbbd-f98956ff49ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.239148 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7fbe4-54b6-44f2-bbbd-f98956ff49ae admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.239422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7fbe4-54b6-44f2-bbbd-f98956ff49ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.239697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7fbe4-54b6-44f2-bbbd-f98956ff49ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.240422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7fbe4-54b6-44f2-bbbd-f98956ff49ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.242092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7fbe4-54b6-44f2-bbbd-f98956ff49ae admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.258313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1192/2425] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:34.260711 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe40d-cf5e-4154-ae39-0000ccac1e73 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.271086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe40d-cf5e-4154-ae39-0000ccac1e73 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.276491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186d934-9c7f-4fbf-8012-c135980d0748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.277397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186d934-9c7f-4fbf-8012-c135980d0748 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.277678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186d934-9c7f-4fbf-8012-c135980d0748 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.277952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186d934-9c7f-4fbf-8012-c135980d0748 admin admin] PATH_INFO: `/v3/projects/0277e2aa729e47aea0f5ed3efaee3918/users/fb005268fab14792bcfedd2d242efd9f/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.293337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186d934-9c7f-4fbf-8012-c135980d0748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0277e2aa729e47aea0f5ed3efaee3918, user_id=fb005268fab14792bcfedd2d242efd9f, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.296157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186d934-9c7f-4fbf-8012-c135980d0748 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.309912 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1234/2426] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:34 2021] PUT /identity/v3/projects/0277e2aa729e47aea0f5ed3efaee3918/users/fb005268fab14792bcfedd2d242efd9f/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:34.320653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22aeee-a6da-4d63-b9fb-994648186c79 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.320982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22aeee-a6da-4d63-b9fb-994648186c79 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.321260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22aeee-a6da-4d63-b9fb-994648186c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.349679 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-4e22aeee-a6da-4d63-b9fb-994648186c79 None None] MFA Rules not processed for user `fb005268fab14792bcfedd2d242efd9f`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:34.350920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-4e22aeee-a6da-4d63-b9fb-994648186c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:34.418263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1193/2427] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:34 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:34.422780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186d934-9c7f-4fbf-8012-c135980d0748 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.502402 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186d934-9c7f-4fbf-8012-c135980d0748 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.521068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f719fe5-2244-42cd-8aba-5a995ac7215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.522084 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f719fe5-2244-42cd-8aba-5a995ac7215f admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.522287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f719fe5-2244-42cd-8aba-5a995ac7215f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.522662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f719fe5-2244-42cd-8aba-5a995ac7215f admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.523554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f719fe5-2244-42cd-8aba-5a995ac7215f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.525552 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f719fe5-2244-42cd-8aba-5a995ac7215f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.558390 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1235/2428] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:34 2021] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:34.562439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22aeee-a6da-4d63-b9fb-994648186c79 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.575820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22aeee-a6da-4d63-b9fb-994648186c79 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.645803 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc0fa6-0495-4632-a12e-650e2489b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.646491 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc0fa6-0495-4632-a12e-650e2489b63a admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.646866 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc0fa6-0495-4632-a12e-650e2489b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.647153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc0fa6-0495-4632-a12e-650e2489b63a admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.647841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc0fa6-0495-4632-a12e-650e2489b63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.650138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc0fa6-0495-4632-a12e-650e2489b63a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.674278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1194/2429] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:34 2021] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:34.675564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f719fe5-2244-42cd-8aba-5a995ac7215f admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.687210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f719fe5-2244-42cd-8aba-5a995ac7215f admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.693714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b625a-7527-4a9c-9ce2-c3917842a174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.694438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b625a-7527-4a9c-9ce2-c3917842a174 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.694786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b625a-7527-4a9c-9ce2-c3917842a174 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.695065 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b625a-7527-4a9c-9ce2-c3917842a174 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.696369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b625a-7527-4a9c-9ce2-c3917842a174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.697975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b625a-7527-4a9c-9ce2-c3917842a174 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.711223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1236/2430] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:34 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:34.715213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc0fa6-0495-4632-a12e-650e2489b63a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.725770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc0fa6-0495-4632-a12e-650e2489b63a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.731183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085ff2f-9d15-4a35-94e0-50e8cca91f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.731892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ff2f-9d15-4a35-94e0-50e8cca91f42 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.732178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ff2f-9d15-4a35-94e0-50e8cca91f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.732458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ff2f-9d15-4a35-94e0-50e8cca91f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.733196 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085ff2f-9d15-4a35-94e0-50e8cca91f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.734887 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085ff2f-9d15-4a35-94e0-50e8cca91f42 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.746319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1195/2431] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:34 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:30:34.750658 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b625a-7527-4a9c-9ce2-c3917842a174 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.762716 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b625a-7527-4a9c-9ce2-c3917842a174 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.767291 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0530a-0b03-475d-8c6f-e98f64eff3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.768208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0530a-0b03-475d-8c6f-e98f64eff3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.768495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0530a-0b03-475d-8c6f-e98f64eff3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.768795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0530a-0b03-475d-8c6f-e98f64eff3ba admin admin] PATH_INFO: `/v3/projects/204d9a2eed884040a0cc46b8769c9fa1/users/d5aba66afc4548ab81925028c6ce3430/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.785485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0530a-0b03-475d-8c6f-e98f64eff3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=204d9a2eed884040a0cc46b8769c9fa1, user_id=d5aba66afc4548ab81925028c6ce3430, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.788338 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0530a-0b03-475d-8c6f-e98f64eff3ba admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:34.805160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1237/2432] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:34 2021] PUT /identity/v3/projects/204d9a2eed884040a0cc46b8769c9fa1/users/d5aba66afc4548ab81925028c6ce3430/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:34.815117 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabafcaf-e976-4609-a77d-456c65b9b282 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.815418 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabafcaf-e976-4609-a77d-456c65b9b282 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.815698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabafcaf-e976-4609-a77d-456c65b9b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.844449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-aabafcaf-e976-4609-a77d-456c65b9b282 None None] MFA Rules not processed for user `d5aba66afc4548ab81925028c6ce3430`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:34.845681 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-aabafcaf-e976-4609-a77d-456c65b9b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:34.911555 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1196/2433] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:34 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:34.919239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0530a-0b03-475d-8c6f-e98f64eff3ba admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:34.983838 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0530a-0b03-475d-8c6f-e98f64eff3ba admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:34.988970 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239321-02e4-42dd-a670-98b543ed79bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:34.989641 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239321-02e4-42dd-a670-98b543ed79bc admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:34.989925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239321-02e4-42dd-a670-98b543ed79bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:34.990235 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239321-02e4-42dd-a670-98b543ed79bc admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:34.990952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0239321-02e4-42dd-a670-98b543ed79bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:34.993593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0239321-02e4-42dd-a670-98b543ed79bc admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:35.020004 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1238/2434] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:30:34 2021] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:30:35.024183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabafcaf-e976-4609-a77d-456c65b9b282 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:35.034552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabafcaf-e976-4609-a77d-456c65b9b282 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:35.090159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b75d5-a6bd-4ee5-9ae7-f773ee2135c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:35.091587 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b75d5-a6bd-4ee5-9ae7-f773ee2135c7 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:35.091896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b75d5-a6bd-4ee5-9ae7-f773ee2135c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:35.092186 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b75d5-a6bd-4ee5-9ae7-f773ee2135c7 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:35.093020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b75d5-a6bd-4ee5-9ae7-f773ee2135c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:35.095001 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b75d5-a6bd-4ee5-9ae7-f773ee2135c7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:35.115728 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1197/2435] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:30:35 2021] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:30:35.122068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239321-02e4-42dd-a670-98b543ed79bc admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:35.135988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239321-02e4-42dd-a670-98b543ed79bc admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:35.145715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e07b02-7d6b-4b12-8862-93a723f2fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:35.146399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e07b02-7d6b-4b12-8862-93a723f2fbeb admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:35.146696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e07b02-7d6b-4b12-8862-93a723f2fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:35.147001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e07b02-7d6b-4b12-8862-93a723f2fbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:35.147728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e07b02-7d6b-4b12-8862-93a723f2fbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:35.149890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e07b02-7d6b-4b12-8862-93a723f2fbeb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:35.162114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1239/2436] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:35 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:30:35.166969 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b75d5-a6bd-4ee5-9ae7-f773ee2135c7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:35.179922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b75d5-a6bd-4ee5-9ae7-f773ee2135c7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:35.184802 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1d96-30da-45e9-8977-b31882115afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:35.185799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1d96-30da-45e9-8977-b31882115afc admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:35.186178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1d96-30da-45e9-8977-b31882115afc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:35.186475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1d96-30da-45e9-8977-b31882115afc admin admin] PATH_INFO: `/v3/projects/99881867fa9b437f8b18466955af35f8/users/8e23f5a7b4404e5680b391633ca1072f/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:35.201812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a1d96-30da-45e9-8977-b31882115afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=99881867fa9b437f8b18466955af35f8, user_id=8e23f5a7b4404e5680b391633ca1072f, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:35.205961 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a1d96-30da-45e9-8977-b31882115afc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:35.224891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1198/2437] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:35 2021] PUT /identity/v3/projects/99881867fa9b437f8b18466955af35f8/users/8e23f5a7b4404e5680b391633ca1072f/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:35.229640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e07b02-7d6b-4b12-8862-93a723f2fbeb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:35.240283 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e07b02-7d6b-4b12-8862-93a723f2fbeb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:35.325528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d51cd-439f-467d-8554-73a501664a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:35.326327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d51cd-439f-467d-8554-73a501664a9f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:35.326614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d51cd-439f-467d-8554-73a501664a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:35.327120 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d51cd-439f-467d-8554-73a501664a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:35.328183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d51cd-439f-467d-8554-73a501664a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:35.329947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d51cd-439f-467d-8554-73a501664a9f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:35.340525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1240/2438] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:30:35 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:30:35.344699 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1d96-30da-45e9-8977-b31882115afc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:35.355445 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1d96-30da-45e9-8977-b31882115afc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:35.360053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f902e0d-0f46-4f01-87a9-902cdfa5f707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:35.360924 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f902e0d-0f46-4f01-87a9-902cdfa5f707 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:35.361202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f902e0d-0f46-4f01-87a9-902cdfa5f707 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:35.361474 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f902e0d-0f46-4f01-87a9-902cdfa5f707 admin admin] PATH_INFO: `/v3/projects/99881867fa9b437f8b18466955af35f8/users/8e23f5a7b4404e5680b391633ca1072f/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:35.363414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f902e0d-0f46-4f01-87a9-902cdfa5f707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99881867fa9b437f8b18466955af35f8, user_id=8e23f5a7b4404e5680b391633ca1072f, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:35.366064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f902e0d-0f46-4f01-87a9-902cdfa5f707 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:35.377364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1199/2439] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:30:35 2021] PUT /identity/v3/projects/99881867fa9b437f8b18466955af35f8/users/8e23f5a7b4404e5680b391633ca1072f/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:35.388709 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bced9-7bd9-4017-8f9f-acd1f9ba534b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:35.388995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bced9-7bd9-4017-8f9f-acd1f9ba534b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:35.389272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bced9-7bd9-4017-8f9f-acd1f9ba534b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:35.416921 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-240bced9-7bd9-4017-8f9f-acd1f9ba534b None None] MFA Rules not processed for user `8e23f5a7b4404e5680b391633ca1072f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:35.418246 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-240bced9-7bd9-4017-8f9f-acd1f9ba534b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:35.494803 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1241/2440] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:35 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:35.505031 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f902e0d-0f46-4f01-87a9-902cdfa5f707 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:35.506916 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3f902e0d-0f46-4f01-87a9-902cdfa5f707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:35.591984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f902e0d-0f46-4f01-87a9-902cdfa5f707 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:35.596203 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f0c24-1db3-4a6e-983f-79651ca3489e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:35.597087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f0c24-1db3-4a6e-983f-79651ca3489e service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:35.598052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f0c24-1db3-4a6e-983f-79651ca3489e service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:35.598339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f0c24-1db3-4a6e-983f-79651ca3489e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:35.661534 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f0c24-1db3-4a6e-983f-79651ca3489e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:35.663000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f0c24-1db3-4a6e-983f-79651ca3489e service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:35.671874 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1200/2441] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:35 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:37.187132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bced9-7bd9-4017-8f9f-acd1f9ba534b None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:37.204528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bced9-7bd9-4017-8f9f-acd1f9ba534b None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:37.210133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc18880-f4e5-410d-998f-c490c663484a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:37.211636 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc18880-f4e5-410d-998f-c490c663484a service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:37.212021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc18880-f4e5-410d-998f-c490c663484a service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:37.212404 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc18880-f4e5-410d-998f-c490c663484a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:37.303721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc18880-f4e5-410d-998f-c490c663484a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:37.310733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc18880-f4e5-410d-998f-c490c663484a service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:37.326261 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1242/2442] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:37 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:38.041880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f0c24-1db3-4a6e-983f-79651ca3489e service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:38.043340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-de9f0c24-1db3-4a6e-983f-79651ca3489e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:38.054098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f0c24-1db3-4a6e-983f-79651ca3489e service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:38.058837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ea3ab-ac17-4247-ae8b-8de7254c54e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:38.059502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ea3ab-ac17-4247-ae8b-8de7254c54e0 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:38.059789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ea3ab-ac17-4247-ae8b-8de7254c54e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:38.060070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ea3ab-ac17-4247-ae8b-8de7254c54e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:38.069786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ea3ab-ac17-4247-ae8b-8de7254c54e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:38.072038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ea3ab-ac17-4247-ae8b-8de7254c54e0 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:38.081591 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1201/2443] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:38 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:41.948466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc18880-f4e5-410d-998f-c490c663484a service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:42.008848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc18880-f4e5-410d-998f-c490c663484a service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:42.013572 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:42.014428 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:42.014736 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:42.015023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] PATH_INFO: `/v3/users/fb005268fab14792bcfedd2d242efd9f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:42.016198 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb005268fab14792bcfedd2d242efd9f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:42.018098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:42.064175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb005268fab14792bcfedd2d242efd9f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.075519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb005268fab14792bcfedd2d242efd9f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.076224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb005268fab14792bcfedd2d242efd9f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.083154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb005268fab14792bcfedd2d242efd9f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.083784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb005268fab14792bcfedd2d242efd9f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.097172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1243/2444] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:41 2021] DELETE /identity/v3/users/fb005268fab14792bcfedd2d242efd9f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:42.101697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a47e38-1ede-44ac-8b65-b70da3fa87d4 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:42.102219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a47e38-1ede-44ac-8b65-b70da3fa87d4 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:42.102389 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a47e38-1ede-44ac-8b65-b70da3fa87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:42.121217 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-18a47e38-1ede-44ac-8b65-b70da3fa87d4 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:42.122487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-18a47e38-1ede-44ac-8b65-b70da3fa87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:42.182700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1202/2445] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:42.192914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:42.194335 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:42.252130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f3261-aa2d-4793-8e7f-8f2d1d55fd02 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:42.256168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b381ba5-f699-44dc-8e95-8eb3c4c112c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:42.256814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381ba5-f699-44dc-8e95-8eb3c4c112c2 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:42.257130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381ba5-f699-44dc-8e95-8eb3c4c112c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:42.257520 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381ba5-f699-44dc-8e95-8eb3c4c112c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:42.267739 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b381ba5-f699-44dc-8e95-8eb3c4c112c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:42.269208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b381ba5-f699-44dc-8e95-8eb3c4c112c2 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:42.283289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1244/2446] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:30:42.354806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a47e38-1ede-44ac-8b65-b70da3fa87d4 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:42.356401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-18a47e38-1ede-44ac-8b65-b70da3fa87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:42.368377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a47e38-1ede-44ac-8b65-b70da3fa87d4 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:42.373065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:42.374075 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:42.374359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:42.374631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] PATH_INFO: `/v3/users/394a195e156b49c4b36b989862f8372e` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:42.375842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=394a195e156b49c4b36b989862f8372e)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:42.377820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:42.424977 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394a195e156b49c4b36b989862f8372e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.432701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394a195e156b49c4b36b989862f8372e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.433496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394a195e156b49c4b36b989862f8372e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.434115 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394a195e156b49c4b36b989862f8372e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.442859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394a195e156b49c4b36b989862f8372e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.461033 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1203/2447] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:42 2021] DELETE /identity/v3/users/394a195e156b49c4b36b989862f8372e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:42.465749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd52c2-e24f-4cdf-9dd2-13e7137e0857 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:42.466043 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd52c2-e24f-4cdf-9dd2-13e7137e0857 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:42.466330 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd52c2-e24f-4cdf-9dd2-13e7137e0857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:42.485741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-89fd52c2-e24f-4cdf-9dd2-13e7137e0857 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:30:42.487007 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-89fd52c2-e24f-4cdf-9dd2-13e7137e0857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:42.559993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1245/2448] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:30:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:30:42.572437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:42.573861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:42.579503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd52c2-e24f-4cdf-9dd2-13e7137e0857 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:42.581398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-89fd52c2-e24f-4cdf-9dd2-13e7137e0857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:42.597811 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd52c2-e24f-4cdf-9dd2-13e7137e0857 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:42.602812 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:42.603785 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:42.604071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:42.604376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] PATH_INFO: `/v3/projects/0277e2aa729e47aea0f5ed3efaee3918` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:42.605620 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0277e2aa729e47aea0f5ed3efaee3918)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:42.607721 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:42.634497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3780fa-0f48-4d4e-b0e4-e9bdd57619dc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:42.638779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfa58d-9283-4812-8967-fb302a8727cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:42.639412 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfa58d-9283-4812-8967-fb302a8727cf service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:42.639698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfa58d-9283-4812-8967-fb302a8727cf service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:42.639982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfa58d-9283-4812-8967-fb302a8727cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:42.649195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfa58d-9283-4812-8967-fb302a8727cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:42.650695 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfa58d-9283-4812-8967-fb302a8727cf service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:42.653206 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0277e2aa729e47aea0f5ed3efaee3918', 'request_id': 'req-2beacde7-f623-43db-a568-ca830b0942e9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.659195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0277e2aa729e47aea0f5ed3efaee3918', 'request_id': 'req-2beacde7-f623-43db-a568-ca830b0942e9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.660238 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1204/2449] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:30:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:30:42.664431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0277e2aa729e47aea0f5ed3efaee3918', 'request_id': 'req-2beacde7-f623-43db-a568-ca830b0942e9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.676687 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] The token cache is being invalidate because project 0277e2aa729e47aea0f5ed3efaee3918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:42.676973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.677722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.679304 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1246/2450] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:42 2021] DELETE /identity/v3/projects/0277e2aa729e47aea0f5ed3efaee3918 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:42.683671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfa58d-9283-4812-8967-fb302a8727cf service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:42.693163 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfa58d-9283-4812-8967-fb302a8727cf service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:42.749573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:42.750475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:42.750794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:42.751106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] PATH_INFO: `/v3/users/d5aba66afc4548ab81925028c6ce3430` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:42.752312 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5aba66afc4548ab81925028c6ce3430)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:42.754227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:42.799523 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5aba66afc4548ab81925028c6ce3430'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.806598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5aba66afc4548ab81925028c6ce3430'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.807302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5aba66afc4548ab81925028c6ce3430'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.807930 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5aba66afc4548ab81925028c6ce3430'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.818752 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5aba66afc4548ab81925028c6ce3430'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:42.837454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1205/2451] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:42 2021] DELETE /identity/v3/users/d5aba66afc4548ab81925028c6ce3430 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:30:42.940732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:42.942333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:42.963780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beacde7-f623-43db-a568-ca830b0942e9 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:43.035232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:43.036100 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:43.036378 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:43.036650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] PATH_INFO: `/v3/projects/85eb91637b4c4d27913fe39797a4d79a` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:43.037809 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85eb91637b4c4d27913fe39797a4d79a)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:43.039799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:43.086474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85eb91637b4c4d27913fe39797a4d79a', 'request_id': 'req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.092630 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85eb91637b4c4d27913fe39797a4d79a', 'request_id': 'req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.098270 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85eb91637b4c4d27913fe39797a4d79a', 'request_id': 'req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.110763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] The token cache is being invalidate because project 85eb91637b4c4d27913fe39797a4d79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:43.111056 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.111682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.113414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1247/2452] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:42 2021] DELETE /identity/v3/projects/85eb91637b4c4d27913fe39797a4d79a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:43.135015 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:43.136690 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:43.151147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b59a-bc3c-471d-89be-bc48af854345 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:43.213625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:43.214504 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:43.214824 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:43.215103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] PATH_INFO: `/v3/projects/204d9a2eed884040a0cc46b8769c9fa1` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:43.216330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=204d9a2eed884040a0cc46b8769c9fa1)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:43.218300 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:43.266781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204d9a2eed884040a0cc46b8769c9fa1', 'request_id': 'req-e0ba3902-5513-4074-a019-c3f7997fb2f6'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.273388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204d9a2eed884040a0cc46b8769c9fa1', 'request_id': 'req-e0ba3902-5513-4074-a019-c3f7997fb2f6'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.279443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204d9a2eed884040a0cc46b8769c9fa1', 'request_id': 'req-e0ba3902-5513-4074-a019-c3f7997fb2f6'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.291337 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] The token cache is being invalidate because project 204d9a2eed884040a0cc46b8769c9fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:43.291627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.292311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.293848 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1206/2453] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:43 2021] DELETE /identity/v3/projects/204d9a2eed884040a0cc46b8769c9fa1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:43.297998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:43.299458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:43.311508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d643b2-bf96-4e70-ae1c-f38a92cd1a7b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:43.367616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:43.369010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:43.369288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:43.369561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] PATH_INFO: `/v3/users/8e23f5a7b4404e5680b391633ca1072f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:43.370944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e23f5a7b4404e5680b391633ca1072f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:43.372952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:43.421421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e23f5a7b4404e5680b391633ca1072f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.433729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e23f5a7b4404e5680b391633ca1072f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.434449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e23f5a7b4404e5680b391633ca1072f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.446930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e23f5a7b4404e5680b391633ca1072f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.446930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e23f5a7b4404e5680b391633ca1072f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.456143 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1248/2454] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:30:43 2021] DELETE /identity/v3/users/8e23f5a7b4404e5680b391633ca1072f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:30:43.730475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:30:43.732010 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:30:43.747606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba3902-5513-4074-a019-c3f7997fb2f6 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:30:43.804122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:30:43.804979 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:30:43.805263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:30:43.806185 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] PATH_INFO: `/v3/projects/99881867fa9b437f8b18466955af35f8` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:30:43.807379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99881867fa9b437f8b18466955af35f8)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:30:43.809267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:30:43.853227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99881867fa9b437f8b18466955af35f8', 'request_id': 'req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.859615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99881867fa9b437f8b18466955af35f8', 'request_id': 'req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.864861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99881867fa9b437f8b18466955af35f8', 'request_id': 'req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.877074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] The token cache is being invalidate because project 99881867fa9b437f8b18466955af35f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:30:43.877368 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.877981 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:30:43.879506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1207/2455] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:30:43 2021] DELETE /identity/v3/projects/99881867fa9b437f8b18466955af35f8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:31:03.681410 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:31:03.682987 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:31:03.698372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98709e59-af81-4a37-91fb-73bcc43e8351 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:31:03.752747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:31:03.753541 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:03.753822 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:03.754093 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] PATH_INFO: `/v3/users/ae3376227e8648fb9d2e46875db4b998` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:03.755312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3376227e8648fb9d2e46875db4b998)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:31:03.757269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:31:03.811765 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3376227e8648fb9d2e46875db4b998'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:31:03.825612 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3376227e8648fb9d2e46875db4b998'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:31:03.826643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3376227e8648fb9d2e46875db4b998'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:31:03.834823 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3376227e8648fb9d2e46875db4b998'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:31:03.835532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-d24662c8-3d24-4adc-8468-075a14c0c9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3376227e8648fb9d2e46875db4b998'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:31:03.850249 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1249/2456] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:31:03 2021] DELETE /identity/v3/users/ae3376227e8648fb9d2e46875db4b998 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:31:04.022839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:31:04.024369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:31:04.037280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42d843-5ab2-4b2c-99b4-6d1838ba90a2 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:31:04.092038 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:31:04.092976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.093262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.093541 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] PATH_INFO: `/v3/projects/9332813e5ed544a58621b5d1c5e0bbba` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.094732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9332813e5ed544a58621b5d1c5e0bbba)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:31:04.096622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:31:04.141461 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9332813e5ed544a58621b5d1c5e0bbba', 'request_id': 'req-9fa99116-1525-407e-aeed-a3d16e4ff9d0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:31:04.147715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9332813e5ed544a58621b5d1c5e0bbba', 'request_id': 'req-9fa99116-1525-407e-aeed-a3d16e4ff9d0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:31:04.153733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9332813e5ed544a58621b5d1c5e0bbba', 'request_id': 'req-9fa99116-1525-407e-aeed-a3d16e4ff9d0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:31:04.165709 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] The token cache is being invalidate because project 9332813e5ed544a58621b5d1c5e0bbba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:31:04.165999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:31:04.166616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9fa99116-1525-407e-aeed-a3d16e4ff9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:31:04.168128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1208/2457] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:31:04 2021] DELETE /identity/v3/projects/9332813e5ed544a58621b5d1c5e0bbba => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:31:04.174609 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f68b-53d6-448f-bbce-f46097c8fdf9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.174930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f68b-53d6-448f-bbce-f46097c8fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.175210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f68b-53d6-448f-bbce-f46097c8fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.192599 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-3466f68b-53d6-448f-bbce-f46097c8fdf9 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:31:04.193780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-3466f68b-53d6-448f-bbce-f46097c8fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:31:04.249332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1250/2458] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:31:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:31:04.257086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476451bf-1b89-4424-ae4b-425bdf93c88f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.257377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476451bf-1b89-4424-ae4b-425bdf93c88f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.257664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476451bf-1b89-4424-ae4b-425bdf93c88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.275952 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-476451bf-1b89-4424-ae4b-425bdf93c88f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:31:04.277139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-476451bf-1b89-4424-ae4b-425bdf93c88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:31:04.285764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1209/2459] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:31:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:31:04.289981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466f68b-53d6-448f-bbce-f46097c8fdf9 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:31:04.299622 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466f68b-53d6-448f-bbce-f46097c8fdf9 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:31:04.304394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45986517-fbee-4eaa-a86d-48fe78925a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:31:04.305614 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45986517-fbee-4eaa-a86d-48fe78925a8a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.305893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45986517-fbee-4eaa-a86d-48fe78925a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.306166 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45986517-fbee-4eaa-a86d-48fe78925a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.307077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45986517-fbee-4eaa-a86d-48fe78925a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:31:04.307387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45986517-fbee-4eaa-a86d-48fe78925a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:31:04.308979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45986517-fbee-4eaa-a86d-48fe78925a8a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:31:04.320341 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1251/2460] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:31:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:31:04.324529 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476451bf-1b89-4424-ae4b-425bdf93c88f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:31:04.333863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476451bf-1b89-4424-ae4b-425bdf93c88f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:31:04.340350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2f09-458a-44f8-ad43-5a5d3021c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:31:04.341953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2f09-458a-44f8-ad43-5a5d3021c5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.342449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2f09-458a-44f8-ad43-5a5d3021c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.342656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2f09-458a-44f8-ad43-5a5d3021c5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.343271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d2f09-458a-44f8-ad43-5a5d3021c5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:31:04.345379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d2f09-458a-44f8-ad43-5a5d3021c5f9 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:31:04.371177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1210/2461] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:31:04 2021] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:31:04.375337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45986517-fbee-4eaa-a86d-48fe78925a8a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:31:04.385252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45986517-fbee-4eaa-a86d-48fe78925a8a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:31:04.440951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962c2b2-bac6-452f-84b2-8ffccc1836cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:31:04.441608 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962c2b2-bac6-452f-84b2-8ffccc1836cb admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.441919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962c2b2-bac6-452f-84b2-8ffccc1836cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.442199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962c2b2-bac6-452f-84b2-8ffccc1836cb admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.442894 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962c2b2-bac6-452f-84b2-8ffccc1836cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:31:04.444805 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962c2b2-bac6-452f-84b2-8ffccc1836cb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:31:04.464995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1252/2462] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:31:04 2021] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:31:04.469479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2f09-458a-44f8-ad43-5a5d3021c5f9 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:31:04.480116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2f09-458a-44f8-ad43-5a5d3021c5f9 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:31:04.485057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322596a-0615-4583-b6db-d163ae503980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:31:04.485723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322596a-0615-4583-b6db-d163ae503980 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.486006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322596a-0615-4583-b6db-d163ae503980 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.486284 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322596a-0615-4583-b6db-d163ae503980 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.487041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322596a-0615-4583-b6db-d163ae503980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:31:04.488700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322596a-0615-4583-b6db-d163ae503980 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:31:04.500927 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1211/2463] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:31:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:31:04.504932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962c2b2-bac6-452f-84b2-8ffccc1836cb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:31:04.516568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962c2b2-bac6-452f-84b2-8ffccc1836cb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:31:04.521758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b8877-7781-4a31-8cb6-a23930019a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:31:04.522434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b8877-7781-4a31-8cb6-a23930019a88 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.522744 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b8877-7781-4a31-8cb6-a23930019a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.523044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b8877-7781-4a31-8cb6-a23930019a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.523775 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b8877-7781-4a31-8cb6-a23930019a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:31:04.525376 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b8877-7781-4a31-8cb6-a23930019a88 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:31:04.536192 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1253/2464] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:31:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:31:04.540169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322596a-0615-4583-b6db-d163ae503980 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:31:04.549917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322596a-0615-4583-b6db-d163ae503980 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:31:04.554510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc00692-d2a2-4462-a3be-80955a597752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:31:04.555401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc00692-d2a2-4462-a3be-80955a597752 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.555678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc00692-d2a2-4462-a3be-80955a597752 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.555947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc00692-d2a2-4462-a3be-80955a597752 admin admin] PATH_INFO: `/v3/projects/0d3f6d9b58da4cf08feb13c48725af79/users/a8a2c266dd464ce2a957aa7960049b9d/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.570427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc00692-d2a2-4462-a3be-80955a597752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3f6d9b58da4cf08feb13c48725af79, user_id=a8a2c266dd464ce2a957aa7960049b9d, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:31:04.573121 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc00692-d2a2-4462-a3be-80955a597752 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:31:04.586361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1212/2465] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:31:04 2021] PUT /identity/v3/projects/0d3f6d9b58da4cf08feb13c48725af79/users/a8a2c266dd464ce2a957aa7960049b9d/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:31:04.592844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3750c-f9b5-47a1-9521-bb7628ef5581 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.593075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3750c-f9b5-47a1-9521-bb7628ef5581 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.593355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3750c-f9b5-47a1-9521-bb7628ef5581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.611010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-f3e3750c-f9b5-47a1-9521-bb7628ef5581 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:31:04.612224 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f3e3750c-f9b5-47a1-9521-bb7628ef5581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:31:04.668512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1254/2466] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:31:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:31:04.678236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc00692-d2a2-4462-a3be-80955a597752 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:31:04.680000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6bc00692-d2a2-4462-a3be-80955a597752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:31:04.735085 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc00692-d2a2-4462-a3be-80955a597752 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:31:04.738716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d03cca-1cf1-4cc0-ad8b-caabe183d62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:31:04.739356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d03cca-1cf1-4cc0-ad8b-caabe183d62f service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:04.739635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d03cca-1cf1-4cc0-ad8b-caabe183d62f service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:04.739902 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d03cca-1cf1-4cc0-ad8b-caabe183d62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:04.749315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d03cca-1cf1-4cc0-ad8b-caabe183d62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:31:04.750750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d03cca-1cf1-4cc0-ad8b-caabe183d62f service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:31:04.761090 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1213/2467] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:31:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:31:08.984454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b5f5c-dd6c-47a0-b507-4fbe7b25d28c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:08.984988 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b5f5c-dd6c-47a0-b507-4fbe7b25d28c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:08.985083 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b5f5c-dd6c-47a0-b507-4fbe7b25d28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:09.024646 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-ba1b5f5c-dd6c-47a0-b507-4fbe7b25d28c None None] MFA Rules not processed for user `a8a2c266dd464ce2a957aa7960049b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:31:09.026226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ba1b5f5c-dd6c-47a0-b507-4fbe7b25d28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:31:09.099382 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1255/2468] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:31:08 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:31:09.111483 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d03cca-1cf1-4cc0-ad8b-caabe183d62f service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:31:09.112929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-03d03cca-1cf1-4cc0-ad8b-caabe183d62f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:31:09.215971 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d03cca-1cf1-4cc0-ad8b-caabe183d62f service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:31:09.221765 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d923f-e3d0-4a5e-8c97-f188a3511613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:31:09.222419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d923f-e3d0-4a5e-8c97-f188a3511613 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:09.222773 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d923f-e3d0-4a5e-8c97-f188a3511613 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:09.223058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d923f-e3d0-4a5e-8c97-f188a3511613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:09.231971 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d923f-e3d0-4a5e-8c97-f188a3511613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:31:09.233586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d923f-e3d0-4a5e-8c97-f188a3511613 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:31:09.242713 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1214/2469] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:31:09 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:31:11.871182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d41612-99e9-4098-95d5-8dab59f54738 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:11.872129 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d41612-99e9-4098-95d5-8dab59f54738 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:11.872623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d41612-99e9-4098-95d5-8dab59f54738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:11.898755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-94d41612-99e9-4098-95d5-8dab59f54738 None None] MFA Rules not processed for user `a8a2c266dd464ce2a957aa7960049b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:31:11.900131 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-94d41612-99e9-4098-95d5-8dab59f54738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:31:11.913021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1256/2470] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:31:11 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:31:20.114635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32724-3cef-4770-b275-a7b2c00f35b0 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:31:20.115212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32724-3cef-4770-b275-a7b2c00f35b0 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:31:20.115457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32724-3cef-4770-b275-a7b2c00f35b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:31:20.133415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-2ac32724-3cef-4770-b275-a7b2c00f35b0 None None] MFA Rules not processed for user `756311ff29b94ccdbb85e2e8ac259f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:31:20.134733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2ac32724-3cef-4770-b275-a7b2c00f35b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:31:20.188314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1215/2471] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:31:20 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:02.919863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd9707-3a1b-40a3-ab64-d002b5994792 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:02.920403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd9707-3a1b-40a3-ab64-d002b5994792 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:02.920403 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd9707-3a1b-40a3-ab64-d002b5994792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:02.938467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-42bd9707-3a1b-40a3-ab64-d002b5994792 None None] MFA Rules not processed for user `e85a2de1c4214589916a2ef12655c5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:02.939697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-42bd9707-3a1b-40a3-ab64-d002b5994792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:02.991252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1257/2472] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:32:02 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:07.024600 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32724-3cef-4770-b275-a7b2c00f35b0 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:07.034003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32724-3cef-4770-b275-a7b2c00f35b0 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:07.037536 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34986bf-9f77-41a4-8c1d-a2588eb7f707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:07.038165 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34986bf-9f77-41a4-8c1d-a2588eb7f707 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:07.038447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34986bf-9f77-41a4-8c1d-a2588eb7f707 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:07.038746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34986bf-9f77-41a4-8c1d-a2588eb7f707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:07.040488 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d34986bf-9f77-41a4-8c1d-a2588eb7f707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:07.053228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34986bf-9f77-41a4-8c1d-a2588eb7f707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:07.054637 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34986bf-9f77-41a4-8c1d-a2588eb7f707 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:07.065649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1216/2473] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:32:11.711387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd9707-3a1b-40a3-ab64-d002b5994792 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:11.720747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd9707-3a1b-40a3-ab64-d002b5994792 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:11.724369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b782fc2-367d-4498-aced-99372806f3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:11.725021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b782fc2-367d-4498-aced-99372806f3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:11.725328 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b782fc2-367d-4498-aced-99372806f3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:11.725579 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b782fc2-367d-4498-aced-99372806f3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:11.727348 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7b782fc2-367d-4498-aced-99372806f3e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:11.740910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b782fc2-367d-4498-aced-99372806f3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:11.742421 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b782fc2-367d-4498-aced-99372806f3e6 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:11.753884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1258/2474] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:11 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:32:13.103932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34986bf-9f77-41a4-8c1d-a2588eb7f707 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:13.106041 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d34986bf-9f77-41a4-8c1d-a2588eb7f707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:13.120923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34986bf-9f77-41a4-8c1d-a2588eb7f707 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:13.126379 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:13.127282 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:13.127570 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:13.127843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] PATH_INFO: `/v3/users/756311ff29b94ccdbb85e2e8ac259f2d` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:13.129177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] RBAC: Authorizing `identity:delete_user(user_id=756311ff29b94ccdbb85e2e8ac259f2d)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:13.131152 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:13.179485 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756311ff29b94ccdbb85e2e8ac259f2d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:32:13.186211 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756311ff29b94ccdbb85e2e8ac259f2d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:32:13.187103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756311ff29b94ccdbb85e2e8ac259f2d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:32:13.188294 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756311ff29b94ccdbb85e2e8ac259f2d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:32:13.195199 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-63fb90d4-021b-498a-9866-cd8e2fe976de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756311ff29b94ccdbb85e2e8ac259f2d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:32:13.211573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1217/2475] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:32:13 2021] DELETE /identity/v3/users/756311ff29b94ccdbb85e2e8ac259f2d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:32:13.383939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b782fc2-367d-4498-aced-99372806f3e6 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:13.400621 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b782fc2-367d-4498-aced-99372806f3e6 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:13.460605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:13.461478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:13.461761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:13.462042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] PATH_INFO: `/v3/projects/91561edb5be742c6b2dfc64b3ffb7be2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:13.463285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=91561edb5be742c6b2dfc64b3ffb7be2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:13.465230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:13.514004 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91561edb5be742c6b2dfc64b3ffb7be2', 'request_id': 'req-c03f1c87-7fb3-4b92-a185-096e15553ebe'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:32:13.520437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91561edb5be742c6b2dfc64b3ffb7be2', 'request_id': 'req-c03f1c87-7fb3-4b92-a185-096e15553ebe'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:32:13.526011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91561edb5be742c6b2dfc64b3ffb7be2', 'request_id': 'req-c03f1c87-7fb3-4b92-a185-096e15553ebe'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:32:13.539640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] The token cache is being invalidate because project 91561edb5be742c6b2dfc64b3ffb7be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:32:13.539936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:32:13.540772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c03f1c87-7fb3-4b92-a185-096e15553ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:32:13.542599 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1259/2476] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:32:13 2021] DELETE /identity/v3/projects/91561edb5be742c6b2dfc64b3ffb7be2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:32:13.548848 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2139bc-a21d-45e8-9d57-b5adcd8feae1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:13.549140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2139bc-a21d-45e8-9d57-b5adcd8feae1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:13.549423 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2139bc-a21d-45e8-9d57-b5adcd8feae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:13.567407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-bb2139bc-a21d-45e8-9d57-b5adcd8feae1 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:13.568639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-bb2139bc-a21d-45e8-9d57-b5adcd8feae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:13.634439 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1218/2477] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:32:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:13.642610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbd96d-24ef-427d-9083-4cb50daadb4e None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:13.642920 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbd96d-24ef-427d-9083-4cb50daadb4e None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:13.643203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbd96d-24ef-427d-9083-4cb50daadb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:13.662326 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-76bbd96d-24ef-427d-9083-4cb50daadb4e None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:13.663636 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-76bbd96d-24ef-427d-9083-4cb50daadb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:13.671711 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1260/2478] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:32:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:13.678477 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2139bc-a21d-45e8-9d57-b5adcd8feae1 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:13.697343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2139bc-a21d-45e8-9d57-b5adcd8feae1 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:13.702269 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80da3f-4867-4f9c-ac7f-23da08b4b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:13.703238 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80da3f-4867-4f9c-ac7f-23da08b4b4fd admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:13.704241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80da3f-4867-4f9c-ac7f-23da08b4b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:13.704594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80da3f-4867-4f9c-ac7f-23da08b4b4fd admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:13.705274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80da3f-4867-4f9c-ac7f-23da08b4b4fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:32:13.707743 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80da3f-4867-4f9c-ac7f-23da08b4b4fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:13.723237 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80da3f-4867-4f9c-ac7f-23da08b4b4fd admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:13.743928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1219/2479] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:32:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:32:13.748128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbd96d-24ef-427d-9083-4cb50daadb4e None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:13.758351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbd96d-24ef-427d-9083-4cb50daadb4e None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:13.766582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9a0b7-72bc-4614-a147-5034b5e73e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:13.767475 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9a0b7-72bc-4614-a147-5034b5e73e53 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:13.767766 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9a0b7-72bc-4614-a147-5034b5e73e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:13.768044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9a0b7-72bc-4614-a147-5034b5e73e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:13.768756 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9a0b7-72bc-4614-a147-5034b5e73e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:13.770664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9a0b7-72bc-4614-a147-5034b5e73e53 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:13.796800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1261/2480] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:32:13 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:32:13.800572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80da3f-4867-4f9c-ac7f-23da08b4b4fd admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:13.810333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80da3f-4867-4f9c-ac7f-23da08b4b4fd admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:13.873638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6dc66-b22e-4b45-9350-0e4b22cec5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:13.874360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6dc66-b22e-4b45-9350-0e4b22cec5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:13.874717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6dc66-b22e-4b45-9350-0e4b22cec5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:13.875020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6dc66-b22e-4b45-9350-0e4b22cec5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:13.876259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6dc66-b22e-4b45-9350-0e4b22cec5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:13.878179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6dc66-b22e-4b45-9350-0e4b22cec5a8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:13.902135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1220/2481] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:32:13 2021] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:32:13.903239 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9a0b7-72bc-4614-a147-5034b5e73e53 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:13.913561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9a0b7-72bc-4614-a147-5034b5e73e53 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:13.918243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a554dae-a3ee-4034-b74f-1236b305caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:13.918932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a554dae-a3ee-4034-b74f-1236b305caa2 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:13.919406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a554dae-a3ee-4034-b74f-1236b305caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:13.919686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a554dae-a3ee-4034-b74f-1236b305caa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:13.920400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a554dae-a3ee-4034-b74f-1236b305caa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:13.922503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a554dae-a3ee-4034-b74f-1236b305caa2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:13.932820 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1262/2482] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:32:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:32:13.936708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6dc66-b22e-4b45-9350-0e4b22cec5a8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:13.947066 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6dc66-b22e-4b45-9350-0e4b22cec5a8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:13.951661 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adaf81-9314-436a-b6fc-0b0b29f757f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:13.952309 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adaf81-9314-436a-b6fc-0b0b29f757f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:13.952595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adaf81-9314-436a-b6fc-0b0b29f757f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:13.952873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adaf81-9314-436a-b6fc-0b0b29f757f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:13.953615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adaf81-9314-436a-b6fc-0b0b29f757f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:13.955244 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adaf81-9314-436a-b6fc-0b0b29f757f8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:13.968080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1221/2483] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:32:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:32:13.969087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a554dae-a3ee-4034-b74f-1236b305caa2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:13.978987 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a554dae-a3ee-4034-b74f-1236b305caa2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:13.983539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacbdd6-1436-4668-8d45-625b43735549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:13.984926 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacbdd6-1436-4668-8d45-625b43735549 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:13.985211 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacbdd6-1436-4668-8d45-625b43735549 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:13.985514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacbdd6-1436-4668-8d45-625b43735549 admin admin] PATH_INFO: `/v3/projects/ada43be06e92474191038a2b41a9f39b/users/2fba46fcf5a742d28b39d9fef9c91df5/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:13.999865 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacbdd6-1436-4668-8d45-625b43735549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada43be06e92474191038a2b41a9f39b, user_id=2fba46fcf5a742d28b39d9fef9c91df5, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:14.003547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacbdd6-1436-4668-8d45-625b43735549 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:14.017841 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1263/2484] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:32:13 2021] PUT /identity/v3/projects/ada43be06e92474191038a2b41a9f39b/users/2fba46fcf5a742d28b39d9fef9c91df5/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:32:14.022948 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf78be-e03c-4ce2-ac30-70b69e5ca644 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:14.023339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf78be-e03c-4ce2-ac30-70b69e5ca644 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:14.023622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf78be-e03c-4ce2-ac30-70b69e5ca644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:14.041103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a0cf78be-e03c-4ce2-ac30-70b69e5ca644 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:14.042268 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a0cf78be-e03c-4ce2-ac30-70b69e5ca644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:14.099736 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1222/2485] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:32:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:14.111469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacbdd6-1436-4668-8d45-625b43735549 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:14.113696 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-daacbdd6-1436-4668-8d45-625b43735549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:14.172624 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacbdd6-1436-4668-8d45-625b43735549 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:14.176487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773518f3-4dd2-4f8a-a4a9-13e758ac091f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:14.177221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773518f3-4dd2-4f8a-a4a9-13e758ac091f service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:14.177586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773518f3-4dd2-4f8a-a4a9-13e758ac091f service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:14.177942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773518f3-4dd2-4f8a-a4a9-13e758ac091f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:14.187345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773518f3-4dd2-4f8a-a4a9-13e758ac091f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:14.189605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773518f3-4dd2-4f8a-a4a9-13e758ac091f service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:14.199106 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1264/2486] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:32:18.724125 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0998fa-f92d-4a33-b230-42d35efe4735 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:18.724667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0998fa-f92d-4a33-b230-42d35efe4735 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:18.724667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0998fa-f92d-4a33-b230-42d35efe4735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:18.754322 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-5a0998fa-f92d-4a33-b230-42d35efe4735 None None] MFA Rules not processed for user `2fba46fcf5a742d28b39d9fef9c91df5`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:18.755753 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5a0998fa-f92d-4a33-b230-42d35efe4735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:18.827618 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1223/2487] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:32:18 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:18.832682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773518f3-4dd2-4f8a-a4a9-13e758ac091f service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:18.842855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773518f3-4dd2-4f8a-a4a9-13e758ac091f service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:18.850554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59398e48-f567-47db-a333-c5ba0bdb4986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:18.851532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59398e48-f567-47db-a333-c5ba0bdb4986 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:18.852005 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59398e48-f567-47db-a333-c5ba0bdb4986 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:18.852475 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59398e48-f567-47db-a333-c5ba0bdb4986 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:18.853347 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59398e48-f567-47db-a333-c5ba0bdb4986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:18.855890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59398e48-f567-47db-a333-c5ba0bdb4986 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:18.888533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1265/2488] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:32:18 2021] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:32:18.893029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0998fa-f92d-4a33-b230-42d35efe4735 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:18.904656 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0998fa-f92d-4a33-b230-42d35efe4735 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:18.994460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f41a9a-7ca2-42d0-a626-9bbd54a3067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:18.995553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f41a9a-7ca2-42d0-a626-9bbd54a3067c admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:18.996234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f41a9a-7ca2-42d0-a626-9bbd54a3067c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:18.996671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f41a9a-7ca2-42d0-a626-9bbd54a3067c admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:18.998329 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f41a9a-7ca2-42d0-a626-9bbd54a3067c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:19.001825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f41a9a-7ca2-42d0-a626-9bbd54a3067c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:19.024527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1224/2489] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:32:18 2021] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:32:19.028672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59398e48-f567-47db-a333-c5ba0bdb4986 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:19.042813 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59398e48-f567-47db-a333-c5ba0bdb4986 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:19.053187 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27ffb8-9ffc-4128-b16f-a875067db105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:19.053890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ffb8-9ffc-4128-b16f-a875067db105 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:19.054209 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ffb8-9ffc-4128-b16f-a875067db105 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:19.054451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ffb8-9ffc-4128-b16f-a875067db105 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:19.055227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27ffb8-9ffc-4128-b16f-a875067db105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:19.057064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27ffb8-9ffc-4128-b16f-a875067db105 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:19.069212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1266/2490] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:32:19 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:32:19.073351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f41a9a-7ca2-42d0-a626-9bbd54a3067c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:19.084136 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f41a9a-7ca2-42d0-a626-9bbd54a3067c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:19.088848 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f849-129b-4b1d-af04-610bf5546920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:19.089727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f849-129b-4b1d-af04-610bf5546920 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:19.090007 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f849-129b-4b1d-af04-610bf5546920 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:19.090278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f849-129b-4b1d-af04-610bf5546920 admin admin] PATH_INFO: `/v3/projects/0c2d14a240674ff392a60602ca5b849a/users/e21f4e15a74c4b338094b3e423a91ae0/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:19.106226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3f849-129b-4b1d-af04-610bf5546920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2d14a240674ff392a60602ca5b849a, user_id=e21f4e15a74c4b338094b3e423a91ae0, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:19.109654 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3f849-129b-4b1d-af04-610bf5546920 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:19.123566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1225/2491] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:32:19 2021] PUT /identity/v3/projects/0c2d14a240674ff392a60602ca5b849a/users/e21f4e15a74c4b338094b3e423a91ae0/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:32:19.133347 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27ffb8-9ffc-4128-b16f-a875067db105 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:19.144030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27ffb8-9ffc-4128-b16f-a875067db105 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:19.203359 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c1f51-057a-4cd5-bb40-06fe304b8c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:19.204037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1f51-057a-4cd5-bb40-06fe304b8c08 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:19.204320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1f51-057a-4cd5-bb40-06fe304b8c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:19.204595 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c1f51-057a-4cd5-bb40-06fe304b8c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:19.205320 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c1f51-057a-4cd5-bb40-06fe304b8c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:19.206963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c1f51-057a-4cd5-bb40-06fe304b8c08 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:19.217574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1267/2492] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:32:19 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:32:19.221696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f849-129b-4b1d-af04-610bf5546920 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:19.232208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f849-129b-4b1d-af04-610bf5546920 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:19.237716 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de983d0-891e-4bbb-8bc1-08bc700e1b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:19.238617 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de983d0-891e-4bbb-8bc1-08bc700e1b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:19.238950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de983d0-891e-4bbb-8bc1-08bc700e1b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:19.239437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de983d0-891e-4bbb-8bc1-08bc700e1b0b admin admin] PATH_INFO: `/v3/projects/0c2d14a240674ff392a60602ca5b849a/users/e21f4e15a74c4b338094b3e423a91ae0/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:19.241453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de983d0-891e-4bbb-8bc1-08bc700e1b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2d14a240674ff392a60602ca5b849a, user_id=e21f4e15a74c4b338094b3e423a91ae0, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:19.244333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de983d0-891e-4bbb-8bc1-08bc700e1b0b admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:19.256025 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1226/2493] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:32:19 2021] PUT /identity/v3/projects/0c2d14a240674ff392a60602ca5b849a/users/e21f4e15a74c4b338094b3e423a91ae0/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:32:23.457454 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c8e82-1cde-49b5-9a95-11d7c132af08 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:23.457964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c8e82-1cde-49b5-9a95-11d7c132af08 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:23.458072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c8e82-1cde-49b5-9a95-11d7c132af08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:23.487955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-063c8e82-1cde-49b5-9a95-11d7c132af08 None None] MFA Rules not processed for user `e21f4e15a74c4b338094b3e423a91ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:23.489417 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-063c8e82-1cde-49b5-9a95-11d7c132af08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:23.575273 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1268/2494] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:32:23 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:23.588609 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de983d0-891e-4bbb-8bc1-08bc700e1b0b admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:23.591128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8de983d0-891e-4bbb-8bc1-08bc700e1b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:23.742172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de983d0-891e-4bbb-8bc1-08bc700e1b0b admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:23.752190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce95d5f-65f9-4576-9ac1-4b595113bf0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:23.752943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95d5f-65f9-4576-9ac1-4b595113bf0b service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:23.753598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95d5f-65f9-4576-9ac1-4b595113bf0b service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:23.753598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95d5f-65f9-4576-9ac1-4b595113bf0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:23.825385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce95d5f-65f9-4576-9ac1-4b595113bf0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:23.832259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce95d5f-65f9-4576-9ac1-4b595113bf0b service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:23.852644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1227/2495] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:23 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:32:24.172487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c8e82-1cde-49b5-9a95-11d7c132af08 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:24.173898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-063c8e82-1cde-49b5-9a95-11d7c132af08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:24.189126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c8e82-1cde-49b5-9a95-11d7c132af08 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:24.194562 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441cdb-1a01-4792-abf5-7cfdaf40a131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:24.195221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441cdb-1a01-4792-abf5-7cfdaf40a131 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:24.195503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441cdb-1a01-4792-abf5-7cfdaf40a131 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:24.195777 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441cdb-1a01-4792-abf5-7cfdaf40a131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:24.197413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-bd441cdb-1a01-4792-abf5-7cfdaf40a131 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:24.251753 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd441cdb-1a01-4792-abf5-7cfdaf40a131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:24.253345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd441cdb-1a01-4792-abf5-7cfdaf40a131 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:24.262321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1269/2496] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:24 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:32:35.890269 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af4c8-5bfd-4b86-a4b8-ff9171ec09d6 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:35.890788 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af4c8-5bfd-4b86-a4b8-ff9171ec09d6 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:35.890888 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af4c8-5bfd-4b86-a4b8-ff9171ec09d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:35.936909 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-ef0af4c8-5bfd-4b86-a4b8-ff9171ec09d6 None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:35.938104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ef0af4c8-5bfd-4b86-a4b8-ff9171ec09d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:35.999224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1228/2497] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:32:35 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:36.046221 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441cdb-1a01-4792-abf5-7cfdaf40a131 service nova] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:36.047660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-bd441cdb-1a01-4792-abf5-7cfdaf40a131 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:36.134656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441cdb-1a01-4792-abf5-7cfdaf40a131 service nova] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:36.139933 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be8bab-aaba-43dc-beca-24228b89b30a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:36.140574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be8bab-aaba-43dc-beca-24228b89b30a service swift] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:36.140855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be8bab-aaba-43dc-beca-24228b89b30a service swift] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:36.141129 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be8bab-aaba-43dc-beca-24228b89b30a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:36.149556 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be8bab-aaba-43dc-beca-24228b89b30a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:36.151164 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be8bab-aaba-43dc-beca-24228b89b30a service swift] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:36.159810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1270/2498] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:32:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:32:37.245129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af4c8-5bfd-4b86-a4b8-ff9171ec09d6 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:37.262083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af4c8-5bfd-4b86-a4b8-ff9171ec09d6 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:37.270486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeda69-b99e-4f81-a47d-eb1214d85509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:37.271596 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeda69-b99e-4f81-a47d-eb1214d85509 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:37.272053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeda69-b99e-4f81-a47d-eb1214d85509 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:37.272458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeda69-b99e-4f81-a47d-eb1214d85509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:37.274511 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-44aeda69-b99e-4f81-a47d-eb1214d85509 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:37.288829 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aeda69-b99e-4f81-a47d-eb1214d85509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:37.290593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aeda69-b99e-4f81-a47d-eb1214d85509 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:37.314894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1229/2499] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:32:42.742751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23f92-8019-4d8a-8d4a-1fbbca1a8124 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:42.743358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23f92-8019-4d8a-8d4a-1fbbca1a8124 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:42.743358 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23f92-8019-4d8a-8d4a-1fbbca1a8124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:42.761267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-add23f92-8019-4d8a-8d4a-1fbbca1a8124 None None] MFA Rules not processed for user `2fba46fcf5a742d28b39d9fef9c91df5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:42.762758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-add23f92-8019-4d8a-8d4a-1fbbca1a8124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:42.770133 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1271/2500] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:32:42 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:43.106574 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeda69-b99e-4f81-a47d-eb1214d85509 service nova] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:43.108107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-44aeda69-b99e-4f81-a47d-eb1214d85509 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:43.171369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeda69-b99e-4f81-a47d-eb1214d85509 service nova] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:43.175960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71234-817c-4c99-8c6a-6bad510f099c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:43.176607 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71234-817c-4c99-8c6a-6bad510f099c service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:43.176892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71234-817c-4c99-8c6a-6bad510f099c service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:43.177172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71234-817c-4c99-8c6a-6bad510f099c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:43.178975 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-20a71234-817c-4c99-8c6a-6bad510f099c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:43.190226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71234-817c-4c99-8c6a-6bad510f099c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:43.191698 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71234-817c-4c99-8c6a-6bad510f099c service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:43.201840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1230/2501] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:43 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:32:43.742345 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e48a3-203f-40a4-80ce-0468c8e0cc59 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:43.742638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e48a3-203f-40a4-80ce-0468c8e0cc59 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:43.742949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e48a3-203f-40a4-80ce-0468c8e0cc59 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:43.744975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1272/2502] 10.222.0.23 () {54 vars in 960 bytes} [Wed Aug 25 01:32:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:32:43.752064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc9208-18b8-4a69-bbe7-17105d6b6acd None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:43.752443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc9208-18b8-4a69-bbe7-17105d6b6acd None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:43.752851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc9208-18b8-4a69-bbe7-17105d6b6acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:43.800375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-03dc9208-18b8-4a69-bbe7-17105d6b6acd None None] MFA Rules not processed for user `40b49222a8e4474bbe14019418ec8aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:43.803250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-03dc9208-18b8-4a69-bbe7-17105d6b6acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:43.895368 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1231/2503] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Aug 25 01:32:43 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:43.909722 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e48a3-203f-40a4-80ce-0468c8e0cc59 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:43.925437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e48a3-203f-40a4-80ce-0468c8e0cc59 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:43.930619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5b501-7f4a-4b1c-aac1-6f53f86be973 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b49222a8e4474bbe14019418ec8aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:43.931695 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5b501-7f4a-4b1c-aac1-6f53f86be973 service placement] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:43.931956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5b501-7f4a-4b1c-aac1-6f53f86be973 service placement] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:43.932233 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5b501-7f4a-4b1c-aac1-6f53f86be973 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:43.933996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f8b5b501-7f4a-4b1c-aac1-6f53f86be973 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:43.946153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5b501-7f4a-4b1c-aac1-6f53f86be973 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:43.947801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5b501-7f4a-4b1c-aac1-6f53f86be973 service placement] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:43.960112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1273/2504] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:43 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:32:45.835228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc9208-18b8-4a69-bbe7-17105d6b6acd None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:45.845252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc9208-18b8-4a69-bbe7-17105d6b6acd None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:45.849646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f4db9-e5d8-40ee-b8af-470cbdc9ac81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:45.850378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4db9-e5d8-40ee-b8af-470cbdc9ac81 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:45.850691 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4db9-e5d8-40ee-b8af-470cbdc9ac81 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:45.850991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4db9-e5d8-40ee-b8af-470cbdc9ac81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:45.852859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-990f4db9-e5d8-40ee-b8af-470cbdc9ac81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:45.863227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f4db9-e5d8-40ee-b8af-470cbdc9ac81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:45.864666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f4db9-e5d8-40ee-b8af-470cbdc9ac81 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:45.873161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1232/2505] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:45 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:32:46.637950 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5b501-7f4a-4b1c-aac1-6f53f86be973 service placement] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:46.651938 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5b501-7f4a-4b1c-aac1-6f53f86be973 service placement] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:46.664012 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e1536-240e-4467-ac04-e1bf6dcf1b0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:46.664612 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e1536-240e-4467-ac04-e1bf6dcf1b0b service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:46.664895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e1536-240e-4467-ac04-e1bf6dcf1b0b service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:46.665172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e1536-240e-4467-ac04-e1bf6dcf1b0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:46.667011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-957e1536-240e-4467-ac04-e1bf6dcf1b0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:46.679982 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e1536-240e-4467-ac04-e1bf6dcf1b0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:46.681712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e1536-240e-4467-ac04-e1bf6dcf1b0b service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:46.693323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1274/2506] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:32:50.213627 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e634f73-dd63-482b-b99a-53332b7fb5ad None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:50.214166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e634f73-dd63-482b-b99a-53332b7fb5ad None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:50.214166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e634f73-dd63-482b-b99a-53332b7fb5ad None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:50.216011 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1233/2507] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 25 01:32:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:32:50.222059 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d16fa-65d6-4e01-bb36-9cbf920787e7 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:50.222540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d16fa-65d6-4e01-bb36-9cbf920787e7 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:50.222644 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d16fa-65d6-4e01-bb36-9cbf920787e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:50.262286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-185d16fa-65d6-4e01-bb36-9cbf920787e7 None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:50.263580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-185d16fa-65d6-4e01-bb36-9cbf920787e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:50.273055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1275/2508] 10.222.0.23 () {58 vars in 1019 bytes} [Wed Aug 25 01:32:50 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:32:50.285939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e634f73-dd63-482b-b99a-53332b7fb5ad None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:50.287731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8e634f73-dd63-482b-b99a-53332b7fb5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:50.370972 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e634f73-dd63-482b-b99a-53332b7fb5ad None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:50.373005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311c310-af65-43c0-8d90-3fd9a73ec2db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b9d35e26e64c959e075622321df3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:50.373652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311c310-af65-43c0-8d90-3fd9a73ec2db service glance] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:50.373938 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311c310-af65-43c0-8d90-3fd9a73ec2db service glance] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:50.374218 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311c310-af65-43c0-8d90-3fd9a73ec2db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:50.385378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311c310-af65-43c0-8d90-3fd9a73ec2db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:50.387183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311c310-af65-43c0-8d90-3fd9a73ec2db service glance] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:50.398213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1234/2509] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:50 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:32:50.462849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a53e8-b71c-44b2-ab2b-8e7a4d4a34e6 None None] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:50.463144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a53e8-b71c-44b2-ab2b-8e7a4d4a34e6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:50.463429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a53e8-b71c-44b2-ab2b-8e7a4d4a34e6 None None] PATH_INFO: `/` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:50.465197 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1276/2510] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 25 01:32:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:32:50.470162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be0000-5a7a-4239-807a-ad3495ecaa40 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:50.470458 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be0000-5a7a-4239-807a-ad3495ecaa40 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:50.470772 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be0000-5a7a-4239-807a-ad3495ecaa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:50.488655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a4be0000-5a7a-4239-807a-ad3495ecaa40 None None] MFA Rules not processed for user `a08ace1a65c040bf97108a1660f962ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:50.490135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a4be0000-5a7a-4239-807a-ad3495ecaa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:50.496598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1235/2511] 10.222.0.23 () {58 vars in 1019 bytes} [Wed Aug 25 01:32:50 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:50.509643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a53e8-b71c-44b2-ab2b-8e7a4d4a34e6 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:50.520815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a53e8-b71c-44b2-ab2b-8e7a4d4a34e6 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:50.524369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f08f-6540-4780-89e8-b776bebb0d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:50.524999 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f08f-6540-4780-89e8-b776bebb0d84 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:50.525285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f08f-6540-4780-89e8-b776bebb0d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:50.525564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f08f-6540-4780-89e8-b776bebb0d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:50.532956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939f08f-6540-4780-89e8-b776bebb0d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:50.534416 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939f08f-6540-4780-89e8-b776bebb0d84 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:50.542407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1277/2512] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:32:50 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:32:52.655632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5df6e-43f4-4ed0-bd97-ec2ef97eb761 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:52.656087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5df6e-43f4-4ed0-bd97-ec2ef97eb761 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:52.656179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5df6e-43f4-4ed0-bd97-ec2ef97eb761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:52.675197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-c1a5df6e-43f4-4ed0-bd97-ec2ef97eb761 None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:32:52.676378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c1a5df6e-43f4-4ed0-bd97-ec2ef97eb761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:32:52.683377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1236/2513] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:32:52 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:32:52.695707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f08f-6540-4780-89e8-b776bebb0d84 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:32:52.707961 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f08f-6540-4780-89e8-b776bebb0d84 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:32:52.712917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787959ee-9398-4e5d-bd7a-fa0f9c990eed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:32:52.713545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787959ee-9398-4e5d-bd7a-fa0f9c990eed service swift] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:32:52.713831 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787959ee-9398-4e5d-bd7a-fa0f9c990eed service swift] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:32:52.714109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787959ee-9398-4e5d-bd7a-fa0f9c990eed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:32:52.722568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787959ee-9398-4e5d-bd7a-fa0f9c990eed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:32:52.724158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787959ee-9398-4e5d-bd7a-fa0f9c990eed service swift] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:32:52.731996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1278/2514] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:32:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:33:08.470577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeba78-0281-48d0-9f4e-265867c39266 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:08.471259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeba78-0281-48d0-9f4e-265867c39266 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:08.471259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeba78-0281-48d0-9f4e-265867c39266 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:08.472903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1237/2515] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 25 01:33:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:33:08.478968 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83637c51-acbb-4307-ba1f-019444699422 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:08.479497 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83637c51-acbb-4307-ba1f-019444699422 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:08.479751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83637c51-acbb-4307-ba1f-019444699422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:08.506137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-83637c51-acbb-4307-ba1f-019444699422 None None] MFA Rules not processed for user `a08ace1a65c040bf97108a1660f962ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:08.507386 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-83637c51-acbb-4307-ba1f-019444699422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:08.514432 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1279/2516] 10.222.0.23 () {58 vars in 1019 bytes} [Wed Aug 25 01:33:08 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:08.527361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeba78-0281-48d0-9f4e-265867c39266 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:08.538750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeba78-0281-48d0-9f4e-265867c39266 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:08.542256 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc0e5a-e126-4720-b61a-e5332403852a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:08.542947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0e5a-e126-4720-b61a-e5332403852a service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:08.543219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0e5a-e126-4720-b61a-e5332403852a service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:08.543492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0e5a-e126-4720-b61a-e5332403852a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:08.550996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc0e5a-e126-4720-b61a-e5332403852a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:08.552421 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc0e5a-e126-4720-b61a-e5332403852a service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:08.560654 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1238/2517] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:33:08 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:33:09.828788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83637c51-acbb-4307-ba1f-019444699422 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:09.837593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83637c51-acbb-4307-ba1f-019444699422 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:09.841398 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ea473-e640-4a67-ab33-53af42de265c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:09.842032 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ea473-e640-4a67-ab33-53af42de265c service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:09.842312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ea473-e640-4a67-ab33-53af42de265c service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:09.842585 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ea473-e640-4a67-ab33-53af42de265c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:09.852607 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ea473-e640-4a67-ab33-53af42de265c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:09.854054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ea473-e640-4a67-ab33-53af42de265c service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:09.863616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1280/2518] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:33:09 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:33:11.523823 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc0e5a-e126-4720-b61a-e5332403852a service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:11.536650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc0e5a-e126-4720-b61a-e5332403852a service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:11.542107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd74036-0de9-4f63-aaa6-3197f3ce2a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:11.542776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd74036-0de9-4f63-aaa6-3197f3ce2a91 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:11.543059 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd74036-0de9-4f63-aaa6-3197f3ce2a91 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:11.543330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd74036-0de9-4f63-aaa6-3197f3ce2a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:11.545081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3dd74036-0de9-4f63-aaa6-3197f3ce2a91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:11.557586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd74036-0de9-4f63-aaa6-3197f3ce2a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:11.559189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd74036-0de9-4f63-aaa6-3197f3ce2a91 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:11.570174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1239/2519] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:33:11 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:33:15.349277 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d76880-652a-4fca-b4f8-22f4f0a1d248 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:15.349727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d76880-652a-4fca-b4f8-22f4f0a1d248 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:15.349831 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d76880-652a-4fca-b4f8-22f4f0a1d248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:15.367560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-f1d76880-652a-4fca-b4f8-22f4f0a1d248 None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:15.368753 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f1d76880-652a-4fca-b4f8-22f4f0a1d248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:15.375713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1281/2520] 10.222.0.23 () {58 vars in 968 bytes} [Wed Aug 25 01:33:15 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:15.388092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd74036-0de9-4f63-aaa6-3197f3ce2a91 service nova] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:15.398970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd74036-0de9-4f63-aaa6-3197f3ce2a91 service nova] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:15.404043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2360c8a-d1b7-4afc-b688-5a2ccea1d578 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:15.404697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2360c8a-d1b7-4afc-b688-5a2ccea1d578 service swift] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:15.404984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2360c8a-d1b7-4afc-b688-5a2ccea1d578 service swift] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:15.405263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2360c8a-d1b7-4afc-b688-5a2ccea1d578 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:15.413566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2360c8a-d1b7-4afc-b688-5a2ccea1d578 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:15.415162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2360c8a-d1b7-4afc-b688-5a2ccea1d578 service swift] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:15.423594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1240/2521] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:33:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:33:34.991020 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d76880-652a-4fca-b4f8-22f4f0a1d248 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:35.000038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d76880-652a-4fca-b4f8-22f4f0a1d248 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:35.003532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6525f7-9425-44d8-bb1c-48739fe5c4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:35.004162 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6525f7-9425-44d8-bb1c-48739fe5c4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:35.004443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6525f7-9425-44d8-bb1c-48739fe5c4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:35.004719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6525f7-9425-44d8-bb1c-48739fe5c4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:35.006425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1e6525f7-9425-44d8-bb1c-48739fe5c4c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:35.065679 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6525f7-9425-44d8-bb1c-48739fe5c4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:35.067177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6525f7-9425-44d8-bb1c-48739fe5c4c0 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:35.076522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1282/2522] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:33:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:33:38.156763 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2360c8a-d1b7-4afc-b688-5a2ccea1d578 service swift] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:38.158893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d2360c8a-d1b7-4afc-b688-5a2ccea1d578 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:38.172189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2360c8a-d1b7-4afc-b688-5a2ccea1d578 service swift] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:38.177247 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:38.178220 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.178527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.178833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] PATH_INFO: `/v3/users/e85a2de1c4214589916a2ef12655c5b4` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:38.180002 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85a2de1c4214589916a2ef12655c5b4)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:38.181901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:38.226988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85a2de1c4214589916a2ef12655c5b4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:38.233790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85a2de1c4214589916a2ef12655c5b4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:38.234384 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85a2de1c4214589916a2ef12655c5b4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:38.234992 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85a2de1c4214589916a2ef12655c5b4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:38.241918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3bd8495e-3311-4833-a423-14771b7c97a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85a2de1c4214589916a2ef12655c5b4'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:38.258456 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1241/2523] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:33:38 2021] DELETE /identity/v3/users/e85a2de1c4214589916a2ef12655c5b4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:33:38.426343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6525f7-9425-44d8-bb1c-48739fe5c4c0 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:38.437888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6525f7-9425-44d8-bb1c-48739fe5c4c0 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:38.494415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:38.495243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.495530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.495806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] PATH_INFO: `/v3/projects/b76ebd48c69044859010968bacfba90b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:38.496998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76ebd48c69044859010968bacfba90b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:38.498973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:38.543362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76ebd48c69044859010968bacfba90b', 'request_id': 'req-8efabd7f-b794-456b-b7b5-9522033616b0'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:38.549755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76ebd48c69044859010968bacfba90b', 'request_id': 'req-8efabd7f-b794-456b-b7b5-9522033616b0'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:38.554896 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76ebd48c69044859010968bacfba90b', 'request_id': 'req-8efabd7f-b794-456b-b7b5-9522033616b0'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:38.566601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] The token cache is being invalidate because project b76ebd48c69044859010968bacfba90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:33:38.566917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:38.567535 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8efabd7f-b794-456b-b7b5-9522033616b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:38.569055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1283/2524] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:33:38 2021] DELETE /identity/v3/projects/b76ebd48c69044859010968bacfba90b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:33:38.574610 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5473-e061-45be-b776-3fccdf652b89 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.574921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5473-e061-45be-b776-3fccdf652b89 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.575195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5473-e061-45be-b776-3fccdf652b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:38.592228 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-be1e5473-e061-45be-b776-3fccdf652b89 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:38.593403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-be1e5473-e061-45be-b776-3fccdf652b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:38.649497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1242/2525] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:33:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:38.657034 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9745e-31de-4aca-9013-7a8eee4c5a58 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.657844 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9745e-31de-4aca-9013-7a8eee4c5a58 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.658117 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9745e-31de-4aca-9013-7a8eee4c5a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:38.677169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-cea9745e-31de-4aca-9013-7a8eee4c5a58 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:38.678349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cea9745e-31de-4aca-9013-7a8eee4c5a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:38.685891 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1284/2526] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:33:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:38.689870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e5473-e061-45be-b776-3fccdf652b89 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:38.699208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e5473-e061-45be-b776-3fccdf652b89 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:38.703751 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf80429-189b-498e-832c-3ca85a53ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:38.704387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80429-189b-498e-832c-3ca85a53ddbf admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.704668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80429-189b-498e-832c-3ca85a53ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.704964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80429-189b-498e-832c-3ca85a53ddbf admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:38.705681 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf80429-189b-498e-832c-3ca85a53ddbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:33:38.705987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf80429-189b-498e-832c-3ca85a53ddbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:38.707589 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf80429-189b-498e-832c-3ca85a53ddbf admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:38.718526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1243/2527] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:33:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:33:38.722947 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9745e-31de-4aca-9013-7a8eee4c5a58 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:38.732039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9745e-31de-4aca-9013-7a8eee4c5a58 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:38.737661 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee9e6-686a-4626-ac9a-dc9f60351cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:38.738303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee9e6-686a-4626-ac9a-dc9f60351cce admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.738589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee9e6-686a-4626-ac9a-dc9f60351cce admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.738902 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee9e6-686a-4626-ac9a-dc9f60351cce admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:38.739591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee9e6-686a-4626-ac9a-dc9f60351cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:38.741517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee9e6-686a-4626-ac9a-dc9f60351cce admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:38.765903 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1285/2528] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:33:38 2021] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:33:38.769725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf80429-189b-498e-832c-3ca85a53ddbf admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:38.779430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf80429-189b-498e-832c-3ca85a53ddbf admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:38.832526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b1ec5-a87e-4f51-a6a0-129cca00ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:38.833174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b1ec5-a87e-4f51-a6a0-129cca00ae7c admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.833457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b1ec5-a87e-4f51-a6a0-129cca00ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.833744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b1ec5-a87e-4f51-a6a0-129cca00ae7c admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:38.834421 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b1ec5-a87e-4f51-a6a0-129cca00ae7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:38.836336 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b1ec5-a87e-4f51-a6a0-129cca00ae7c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:38.856707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1244/2529] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:33:38 2021] POST /identity/v3/users => generated 282 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:33:38.861334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee9e6-686a-4626-ac9a-dc9f60351cce admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:38.871638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee9e6-686a-4626-ac9a-dc9f60351cce admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:38.876470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53279ab-f8f6-4647-bddc-c4088e19b8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:38.877364 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53279ab-f8f6-4647-bddc-c4088e19b8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.877864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53279ab-f8f6-4647-bddc-c4088e19b8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.878153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53279ab-f8f6-4647-bddc-c4088e19b8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:38.878922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53279ab-f8f6-4647-bddc-c4088e19b8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:38.880600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53279ab-f8f6-4647-bddc-c4088e19b8f0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:38.891929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1286/2530] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:33:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:33:38.895919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b1ec5-a87e-4f51-a6a0-129cca00ae7c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:38.905820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b1ec5-a87e-4f51-a6a0-129cca00ae7c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:38.911067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e169c-fe2b-4ef0-9617-2e83d8e4b362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:38.911715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e169c-fe2b-4ef0-9617-2e83d8e4b362 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.911995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e169c-fe2b-4ef0-9617-2e83d8e4b362 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.912269 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e169c-fe2b-4ef0-9617-2e83d8e4b362 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:38.912995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e169c-fe2b-4ef0-9617-2e83d8e4b362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:38.914576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e169c-fe2b-4ef0-9617-2e83d8e4b362 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:38.928319 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1245/2531] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:33:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:33:38.932446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53279ab-f8f6-4647-bddc-c4088e19b8f0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:38.942901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53279ab-f8f6-4647-bddc-c4088e19b8f0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:38.947540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb4e4f-65a1-480f-9f69-5dfdfead32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:38.948415 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4e4f-65a1-480f-9f69-5dfdfead32ab admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.948693 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4e4f-65a1-480f-9f69-5dfdfead32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.948966 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4e4f-65a1-480f-9f69-5dfdfead32ab admin admin] PATH_INFO: `/v3/projects/f0510dee71d44236bfee56d024822b21/users/94bc24fc664944c2a2c79320c03f54cd/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:38.963928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb4e4f-65a1-480f-9f69-5dfdfead32ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0510dee71d44236bfee56d024822b21, user_id=94bc24fc664944c2a2c79320c03f54cd, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:38.966601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb4e4f-65a1-480f-9f69-5dfdfead32ab admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:38.982569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1287/2532] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:33:38 2021] PUT /identity/v3/projects/f0510dee71d44236bfee56d024822b21/users/94bc24fc664944c2a2c79320c03f54cd/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:33:38.992436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ae863-4456-4c09-9657-510e646d95ae None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:38.992726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ae863-4456-4c09-9657-510e646d95ae None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:38.993026 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ae863-4456-4c09-9657-510e646d95ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:39.019929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-527ae863-4456-4c09-9657-510e646d95ae None None] MFA Rules not processed for user `94bc24fc664944c2a2c79320c03f54cd`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:39.021108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-527ae863-4456-4c09-9657-510e646d95ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:39.081223 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1246/2533] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:33:38 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:39.085621 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb4e4f-65a1-480f-9f69-5dfdfead32ab admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:39.145564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb4e4f-65a1-480f-9f69-5dfdfead32ab admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:39.150167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719b0fa-c87a-499b-88da-58a35fc4f3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:39.150857 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719b0fa-c87a-499b-88da-58a35fc4f3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:39.151145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719b0fa-c87a-499b-88da-58a35fc4f3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:39.151426 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719b0fa-c87a-499b-88da-58a35fc4f3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:39.152109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719b0fa-c87a-499b-88da-58a35fc4f3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:39.154014 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719b0fa-c87a-499b-88da-58a35fc4f3e7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:39.179209 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1288/2534] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:33:39 2021] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:33:39.183361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ae863-4456-4c09-9657-510e646d95ae None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:39.194232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ae863-4456-4c09-9657-510e646d95ae None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:39.246664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba8b39-e077-448e-b17f-07b7ef024e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:39.247344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba8b39-e077-448e-b17f-07b7ef024e60 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:39.247628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba8b39-e077-448e-b17f-07b7ef024e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:39.247902 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba8b39-e077-448e-b17f-07b7ef024e60 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:39.248580 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba8b39-e077-448e-b17f-07b7ef024e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:39.250467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba8b39-e077-448e-b17f-07b7ef024e60 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:39.269540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1247/2535] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:33:39 2021] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:33:39.273591 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719b0fa-c87a-499b-88da-58a35fc4f3e7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:39.284066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719b0fa-c87a-499b-88da-58a35fc4f3e7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:39.288629 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354e349-472a-4b5f-9dce-aaa403d4eba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:39.289277 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354e349-472a-4b5f-9dce-aaa403d4eba8 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:39.289559 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354e349-472a-4b5f-9dce-aaa403d4eba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:39.289832 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354e349-472a-4b5f-9dce-aaa403d4eba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:39.290544 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354e349-472a-4b5f-9dce-aaa403d4eba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:39.292158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354e349-472a-4b5f-9dce-aaa403d4eba8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:39.302078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1289/2536] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:33:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:33:39.305987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba8b39-e077-448e-b17f-07b7ef024e60 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:39.316104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba8b39-e077-448e-b17f-07b7ef024e60 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:39.320645 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd5cb3-5457-4bbf-a52f-2fbd4e77bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:39.321503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd5cb3-5457-4bbf-a52f-2fbd4e77bc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:39.321785 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd5cb3-5457-4bbf-a52f-2fbd4e77bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:39.322063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd5cb3-5457-4bbf-a52f-2fbd4e77bc7d admin admin] PATH_INFO: `/v3/projects/573b4682aa4e477094af019980f53f21/users/16ae021c156349a69a601dd667be61f2/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:39.336550 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd5cb3-5457-4bbf-a52f-2fbd4e77bc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=573b4682aa4e477094af019980f53f21, user_id=16ae021c156349a69a601dd667be61f2, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:39.339196 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd5cb3-5457-4bbf-a52f-2fbd4e77bc7d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:39.351398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1248/2537] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:33:39 2021] PUT /identity/v3/projects/573b4682aa4e477094af019980f53f21/users/16ae021c156349a69a601dd667be61f2/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:33:39.355106 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354e349-472a-4b5f-9dce-aaa403d4eba8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:39.364677 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354e349-472a-4b5f-9dce-aaa403d4eba8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:39.419087 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdc40-2f30-4241-9348-f3f0fa930eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:39.419744 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdc40-2f30-4241-9348-f3f0fa930eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:39.420030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdc40-2f30-4241-9348-f3f0fa930eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:39.420305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdc40-2f30-4241-9348-f3f0fa930eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:39.421039 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdc40-2f30-4241-9348-f3f0fa930eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:39.422645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdc40-2f30-4241-9348-f3f0fa930eb3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:39.432498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1290/2538] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:33:39 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:33:39.436384 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd5cb3-5457-4bbf-a52f-2fbd4e77bc7d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:39.446931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd5cb3-5457-4bbf-a52f-2fbd4e77bc7d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:39.451480 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b6d4f-9046-4b1f-8066-582b9137f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:39.452344 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6d4f-9046-4b1f-8066-582b9137f270 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:39.452626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6d4f-9046-4b1f-8066-582b9137f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:39.452898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6d4f-9046-4b1f-8066-582b9137f270 admin admin] PATH_INFO: `/v3/projects/573b4682aa4e477094af019980f53f21/users/16ae021c156349a69a601dd667be61f2/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:39.455417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b6d4f-9046-4b1f-8066-582b9137f270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573b4682aa4e477094af019980f53f21, user_id=16ae021c156349a69a601dd667be61f2, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:39.458061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b6d4f-9046-4b1f-8066-582b9137f270 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:39.467931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1249/2539] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:33:39 2021] PUT /identity/v3/projects/573b4682aa4e477094af019980f53f21/users/16ae021c156349a69a601dd667be61f2/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:33:39.478874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c316cf-8a30-41cb-a555-67a18e3bbd58 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:39.479169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c316cf-8a30-41cb-a555-67a18e3bbd58 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:39.479452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c316cf-8a30-41cb-a555-67a18e3bbd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:39.506068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d5c316cf-8a30-41cb-a555-67a18e3bbd58 None None] MFA Rules not processed for user `16ae021c156349a69a601dd667be61f2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:39.507318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d5c316cf-8a30-41cb-a555-67a18e3bbd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:39.572079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1291/2540] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:33:39 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:39.583086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b6d4f-9046-4b1f-8066-582b9137f270 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:39.584807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-272b6d4f-9046-4b1f-8066-582b9137f270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:39.638910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b6d4f-9046-4b1f-8066-582b9137f270 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:39.643526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113dfdf-41b1-43b7-896e-662fdf1b02cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:39.644161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113dfdf-41b1-43b7-896e-662fdf1b02cb service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:39.644499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113dfdf-41b1-43b7-896e-662fdf1b02cb service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:39.644786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113dfdf-41b1-43b7-896e-662fdf1b02cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:39.653660 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113dfdf-41b1-43b7-896e-662fdf1b02cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:39.655118 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113dfdf-41b1-43b7-896e-662fdf1b02cb service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:39.664287 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1250/2541] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:33:39 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:33:39.731946 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c316cf-8a30-41cb-a555-67a18e3bbd58 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:39.741995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c316cf-8a30-41cb-a555-67a18e3bbd58 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:39.745943 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491c4ea-c8da-417c-8d11-9e8896a11e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:39.746583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491c4ea-c8da-417c-8d11-9e8896a11e6d service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:39.746908 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491c4ea-c8da-417c-8d11-9e8896a11e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:39.747189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491c4ea-c8da-417c-8d11-9e8896a11e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:39.801772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491c4ea-c8da-417c-8d11-9e8896a11e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:39.803231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491c4ea-c8da-417c-8d11-9e8896a11e6d service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:39.811900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1292/2542] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:33:39 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:33:42.449532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113dfdf-41b1-43b7-896e-662fdf1b02cb service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:42.508407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113dfdf-41b1-43b7-896e-662fdf1b02cb service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:42.513222 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:42.514073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:42.514355 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:42.514628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] PATH_INFO: `/v3/users/94bc24fc664944c2a2c79320c03f54cd` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:42.515830 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94bc24fc664944c2a2c79320c03f54cd)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:42.517723 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:42.562459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94bc24fc664944c2a2c79320c03f54cd'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:42.568913 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94bc24fc664944c2a2c79320c03f54cd'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:42.569554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94bc24fc664944c2a2c79320c03f54cd'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:42.570161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94bc24fc664944c2a2c79320c03f54cd'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:42.576764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94bc24fc664944c2a2c79320c03f54cd'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:42.593352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1251/2543] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:33:42 2021] DELETE /identity/v3/users/94bc24fc664944c2a2c79320c03f54cd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:33:42.598413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85712-1048-4113-bce7-7f96e2498ac9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:42.598936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85712-1048-4113-bce7-7f96e2498ac9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:42.598936 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85712-1048-4113-bce7-7f96e2498ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:42.616245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a5c85712-1048-4113-bce7-7f96e2498ac9 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:42.617430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a5c85712-1048-4113-bce7-7f96e2498ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:42.672162 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1293/2544] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:33:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:42.681813 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:42.683230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:42.737080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7236-3bb8-4f6a-990d-71fbae917561 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:42.740748 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d808a-255b-4158-b236-557d81292854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:42.741385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d808a-255b-4158-b236-557d81292854 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:42.741672 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d808a-255b-4158-b236-557d81292854 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:42.741950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d808a-255b-4158-b236-557d81292854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:42.750729 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d808a-255b-4158-b236-557d81292854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:42.752139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d808a-255b-4158-b236-557d81292854 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:42.761606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1252/2545] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:33:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:33:43.019651 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85712-1048-4113-bce7-7f96e2498ac9 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:43.021204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a5c85712-1048-4113-bce7-7f96e2498ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:43.033914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85712-1048-4113-bce7-7f96e2498ac9 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:43.038584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:43.039570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:43.040583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:43.040583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] PATH_INFO: `/v3/projects/f0510dee71d44236bfee56d024822b21` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:43.041545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0510dee71d44236bfee56d024822b21)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:43.043672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:43.088627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0510dee71d44236bfee56d024822b21', 'request_id': 'req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.094463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0510dee71d44236bfee56d024822b21', 'request_id': 'req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.099626 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0510dee71d44236bfee56d024822b21', 'request_id': 'req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.111257 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] The token cache is being invalidate because project f0510dee71d44236bfee56d024822b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:33:43.111489 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.112117 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.113589 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1294/2546] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:33:43 2021] DELETE /identity/v3/projects/f0510dee71d44236bfee56d024822b21 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:33:43.117705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d808a-255b-4158-b236-557d81292854 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:43.127517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d808a-255b-4158-b236-557d81292854 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:43.181601 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:43.182450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:43.182754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:43.183029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] PATH_INFO: `/v3/users/16ae021c156349a69a601dd667be61f2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:43.184382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ae021c156349a69a601dd667be61f2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:43.186280 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:43.228092 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ae021c156349a69a601dd667be61f2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.234481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ae021c156349a69a601dd667be61f2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.235153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ae021c156349a69a601dd667be61f2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.235747 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ae021c156349a69a601dd667be61f2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.242560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-99ecf838-0af7-4d81-a285-2188ce642162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ae021c156349a69a601dd667be61f2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.259022 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1253/2547] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:33:43 2021] DELETE /identity/v3/users/16ae021c156349a69a601dd667be61f2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:33:43.524726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:43.526140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:43.539135 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cfc24-4d2d-475c-b66b-cdc5eff40877 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:43.594926 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:43.595792 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:43.596072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:43.596362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] PATH_INFO: `/v3/projects/573b4682aa4e477094af019980f53f21` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:43.597511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=573b4682aa4e477094af019980f53f21)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:43.599440 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:43.642479 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573b4682aa4e477094af019980f53f21', 'request_id': 'req-e23a6266-5ae5-453f-9255-3488ead5e065'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.648177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573b4682aa4e477094af019980f53f21', 'request_id': 'req-e23a6266-5ae5-453f-9255-3488ead5e065'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.653362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573b4682aa4e477094af019980f53f21', 'request_id': 'req-e23a6266-5ae5-453f-9255-3488ead5e065'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.664513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] The token cache is being invalidate because project 573b4682aa4e477094af019980f53f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:33:43.664800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.665411 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-e23a6266-5ae5-453f-9255-3488ead5e065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:33:43.666910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1295/2548] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:33:43 2021] DELETE /identity/v3/projects/573b4682aa4e477094af019980f53f21 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:33:43.672598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c2d0-cf16-45d1-9fe6-9d3f94198823 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:43.673047 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c2d0-cf16-45d1-9fe6-9d3f94198823 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:43.673160 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c2d0-cf16-45d1-9fe6-9d3f94198823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:43.691615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-7127c2d0-cf16-45d1-9fe6-9d3f94198823 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:43.692807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7127c2d0-cf16-45d1-9fe6-9d3f94198823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:43.749331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1254/2549] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:33:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:43.757551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754142ee-970c-4645-b826-b92c9afd2d64 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:43.757840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754142ee-970c-4645-b826-b92c9afd2d64 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:43.758121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754142ee-970c-4645-b826-b92c9afd2d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:43.775834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-754142ee-970c-4645-b826-b92c9afd2d64 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:43.777023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-754142ee-970c-4645-b826-b92c9afd2d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:43.785154 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1296/2550] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:33:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:43.789173 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127c2d0-cf16-45d1-9fe6-9d3f94198823 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:43.798411 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127c2d0-cf16-45d1-9fe6-9d3f94198823 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:43.803503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae7c30-7d00-4272-bbc8-affee37335eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:43.804140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae7c30-7d00-4272-bbc8-affee37335eb admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:43.804418 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae7c30-7d00-4272-bbc8-affee37335eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:43.804695 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae7c30-7d00-4272-bbc8-affee37335eb admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:43.805401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae7c30-7d00-4272-bbc8-affee37335eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:33:43.805702 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae7c30-7d00-4272-bbc8-affee37335eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:43.807306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae7c30-7d00-4272-bbc8-affee37335eb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:43.818171 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1255/2551] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:33:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:33:43.822278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754142ee-970c-4645-b826-b92c9afd2d64 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:43.831278 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754142ee-970c-4645-b826-b92c9afd2d64 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:43.835901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0409192-c2c0-4006-8c1b-f0956288262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:43.836537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0409192-c2c0-4006-8c1b-f0956288262a admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:43.836819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0409192-c2c0-4006-8c1b-f0956288262a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:43.837094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0409192-c2c0-4006-8c1b-f0956288262a admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:43.837776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0409192-c2c0-4006-8c1b-f0956288262a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:43.839703 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0409192-c2c0-4006-8c1b-f0956288262a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:43.864916 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1297/2552] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:33:43 2021] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:33:43.868823 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae7c30-7d00-4272-bbc8-affee37335eb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:43.878388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae7c30-7d00-4272-bbc8-affee37335eb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:43.931947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e766960-4904-45ce-9a15-a127d4c26206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:43.932608 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e766960-4904-45ce-9a15-a127d4c26206 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:43.932892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e766960-4904-45ce-9a15-a127d4c26206 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:43.933172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e766960-4904-45ce-9a15-a127d4c26206 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:43.933863 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e766960-4904-45ce-9a15-a127d4c26206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:43.935812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e766960-4904-45ce-9a15-a127d4c26206 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:43.954446 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1256/2553] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:33:43 2021] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:33:43.958504 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0409192-c2c0-4006-8c1b-f0956288262a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:43.968498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0409192-c2c0-4006-8c1b-f0956288262a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:43.973574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd001053-a3bb-4d47-9dc7-3e439cf837d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:43.974225 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd001053-a3bb-4d47-9dc7-3e439cf837d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:43.974508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd001053-a3bb-4d47-9dc7-3e439cf837d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:43.974824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd001053-a3bb-4d47-9dc7-3e439cf837d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:43.975542 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd001053-a3bb-4d47-9dc7-3e439cf837d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:43.977136 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd001053-a3bb-4d47-9dc7-3e439cf837d4 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:43.987834 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1298/2554] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:33:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:33:43.991521 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e766960-4904-45ce-9a15-a127d4c26206 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:44.000964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e766960-4904-45ce-9a15-a127d4c26206 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:44.005526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e72224-1d81-486c-bd80-30f21c97ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:44.006170 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72224-1d81-486c-bd80-30f21c97ae93 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.006455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72224-1d81-486c-bd80-30f21c97ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.006772 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72224-1d81-486c-bd80-30f21c97ae93 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.007496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e72224-1d81-486c-bd80-30f21c97ae93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:44.009061 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e72224-1d81-486c-bd80-30f21c97ae93 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:44.018918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1257/2555] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:33:43 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:33:44.022981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd001053-a3bb-4d47-9dc7-3e439cf837d4 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:44.032553 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd001053-a3bb-4d47-9dc7-3e439cf837d4 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:44.037553 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777669f-b925-466b-95b4-a67a5e201b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:44.038413 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777669f-b925-466b-95b4-a67a5e201b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.038709 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777669f-b925-466b-95b4-a67a5e201b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.038990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777669f-b925-466b-95b4-a67a5e201b1b admin admin] PATH_INFO: `/v3/projects/2670b0784e764b02b7ccff5044922447/users/c34c8482bb2d4354b204ac25eb50436d/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.053300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777669f-b925-466b-95b4-a67a5e201b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2670b0784e764b02b7ccff5044922447, user_id=c34c8482bb2d4354b204ac25eb50436d, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:44.060151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777669f-b925-466b-95b4-a67a5e201b1b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:44.072803 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1299/2556] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:33:44 2021] PUT /identity/v3/projects/2670b0784e764b02b7ccff5044922447/users/c34c8482bb2d4354b204ac25eb50436d/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:33:44.082780 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d3f21-02e9-49ea-bc03-c9cba61f2fc8 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.083074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d3f21-02e9-49ea-bc03-c9cba61f2fc8 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.083359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d3f21-02e9-49ea-bc03-c9cba61f2fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.109233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-1a1d3f21-02e9-49ea-bc03-c9cba61f2fc8 None None] MFA Rules not processed for user `c34c8482bb2d4354b204ac25eb50436d`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:44.110425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1a1d3f21-02e9-49ea-bc03-c9cba61f2fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:44.171124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1258/2557] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:33:44 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:44.175452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777669f-b925-466b-95b4-a67a5e201b1b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:44.234474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777669f-b925-466b-95b4-a67a5e201b1b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:44.239029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a55c8-9af9-4686-83cc-c13a79b60f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:44.239679 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a55c8-9af9-4686-83cc-c13a79b60f62 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.239958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a55c8-9af9-4686-83cc-c13a79b60f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.240232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a55c8-9af9-4686-83cc-c13a79b60f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.240895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a55c8-9af9-4686-83cc-c13a79b60f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:44.242794 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a55c8-9af9-4686-83cc-c13a79b60f62 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:44.266232 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1300/2558] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:33:44 2021] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:33:44.270911 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d3f21-02e9-49ea-bc03-c9cba61f2fc8 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:44.281331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d3f21-02e9-49ea-bc03-c9cba61f2fc8 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:44.333906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b111ea-318a-4028-b5dc-505c6ae27463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:44.334561 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b111ea-318a-4028-b5dc-505c6ae27463 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.334873 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b111ea-318a-4028-b5dc-505c6ae27463 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.335155 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b111ea-318a-4028-b5dc-505c6ae27463 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.335843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b111ea-318a-4028-b5dc-505c6ae27463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:44.337730 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b111ea-318a-4028-b5dc-505c6ae27463 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:44.356512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1259/2559] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:33:44 2021] POST /identity/v3/users => generated 295 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:33:44.360379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a55c8-9af9-4686-83cc-c13a79b60f62 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:44.370264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a55c8-9af9-4686-83cc-c13a79b60f62 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:44.374778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ac0de-3012-423c-823a-a504047ef86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:44.375422 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ac0de-3012-423c-823a-a504047ef86c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.375702 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ac0de-3012-423c-823a-a504047ef86c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.375976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ac0de-3012-423c-823a-a504047ef86c admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.376683 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ac0de-3012-423c-823a-a504047ef86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:44.378262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ac0de-3012-423c-823a-a504047ef86c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:44.388693 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1301/2560] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:33:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:33:44.393035 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b111ea-318a-4028-b5dc-505c6ae27463 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:44.402644 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b111ea-318a-4028-b5dc-505c6ae27463 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:44.407317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5906059-0a85-41eb-a5d7-22d9bf065e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:44.408790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5906059-0a85-41eb-a5d7-22d9bf065e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.409070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5906059-0a85-41eb-a5d7-22d9bf065e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.409343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5906059-0a85-41eb-a5d7-22d9bf065e8c admin admin] PATH_INFO: `/v3/projects/a5c404523c37432aa17c4f33e090708e/users/47973ed7fa284187bde3996dbe4218c2/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.423625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5906059-0a85-41eb-a5d7-22d9bf065e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c404523c37432aa17c4f33e090708e, user_id=47973ed7fa284187bde3996dbe4218c2, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:44.426251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5906059-0a85-41eb-a5d7-22d9bf065e8c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:44.438425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1260/2561] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:33:44 2021] PUT /identity/v3/projects/a5c404523c37432aa17c4f33e090708e/users/47973ed7fa284187bde3996dbe4218c2/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:33:44.442323 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ac0de-3012-423c-823a-a504047ef86c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:44.452245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ac0de-3012-423c-823a-a504047ef86c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:44.512634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c547b-4b40-4852-9314-c049196fb9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:44.513331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c547b-4b40-4852-9314-c049196fb9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.513598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c547b-4b40-4852-9314-c049196fb9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.513870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c547b-4b40-4852-9314-c049196fb9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.514607 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c547b-4b40-4852-9314-c049196fb9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:44.516231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c547b-4b40-4852-9314-c049196fb9f7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:44.527132 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1302/2562] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:33:44 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:33:44.531227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5906059-0a85-41eb-a5d7-22d9bf065e8c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:44.541924 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5906059-0a85-41eb-a5d7-22d9bf065e8c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:44.546507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824035c-2c20-45d3-8a77-54920f159653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:44.547417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824035c-2c20-45d3-8a77-54920f159653 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.547701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824035c-2c20-45d3-8a77-54920f159653 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.547978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824035c-2c20-45d3-8a77-54920f159653 admin admin] PATH_INFO: `/v3/projects/a5c404523c37432aa17c4f33e090708e/users/47973ed7fa284187bde3996dbe4218c2/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.549983 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824035c-2c20-45d3-8a77-54920f159653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c404523c37432aa17c4f33e090708e, user_id=47973ed7fa284187bde3996dbe4218c2, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:44.552639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824035c-2c20-45d3-8a77-54920f159653 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:44.562502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1261/2563] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:33:44 2021] PUT /identity/v3/projects/a5c404523c37432aa17c4f33e090708e/users/47973ed7fa284187bde3996dbe4218c2/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:33:44.574074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031728e-5897-4a95-b908-c9ef0ec47939 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.574365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031728e-5897-4a95-b908-c9ef0ec47939 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.574645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031728e-5897-4a95-b908-c9ef0ec47939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.600935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7031728e-5897-4a95-b908-c9ef0ec47939 None None] MFA Rules not processed for user `47973ed7fa284187bde3996dbe4218c2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:33:44.602170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7031728e-5897-4a95-b908-c9ef0ec47939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:44.665667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1303/2564] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:33:44 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:33:44.675373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824035c-2c20-45d3-8a77-54920f159653 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:44.677091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8824035c-2c20-45d3-8a77-54920f159653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:33:44.730351 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824035c-2c20-45d3-8a77-54920f159653 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:44.733957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47744e72-f2e6-4468-a299-4c0cda0b91d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:44.734582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744e72-f2e6-4468-a299-4c0cda0b91d0 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:44.734896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744e72-f2e6-4468-a299-4c0cda0b91d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:44.735174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744e72-f2e6-4468-a299-4c0cda0b91d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:44.788588 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47744e72-f2e6-4468-a299-4c0cda0b91d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:44.789928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47744e72-f2e6-4468-a299-4c0cda0b91d0 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:44.798423 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1262/2565] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:33:44 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:33:49.362875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031728e-5897-4a95-b908-c9ef0ec47939 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:33:49.372245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031728e-5897-4a95-b908-c9ef0ec47939 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:33:49.375814 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a437c3-f497-46c7-a174-4831e80d0f37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:33:49.376954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a437c3-f497-46c7-a174-4831e80d0f37 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:33:49.377234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a437c3-f497-46c7-a174-4831e80d0f37 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:33:49.377507 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a437c3-f497-46c7-a174-4831e80d0f37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:33:49.386570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a437c3-f497-46c7-a174-4831e80d0f37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:33:49.388048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a437c3-f497-46c7-a174-4831e80d0f37 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:33:49.397931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1304/2566] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:33:49 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:34:05.189056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f219d7f-ea63-4db2-8bd6-772378e0c959 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:05.189569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f219d7f-ea63-4db2-8bd6-772378e0c959 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:05.189668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f219d7f-ea63-4db2-8bd6-772378e0c959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:05.206665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-2f219d7f-ea63-4db2-8bd6-772378e0c959 None None] MFA Rules not processed for user `a8a2c266dd464ce2a957aa7960049b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:05.207818 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-2f219d7f-ea63-4db2-8bd6-772378e0c959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:05.260147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1263/2567] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:05 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:34:05.548322 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a437c3-f497-46c7-a174-4831e80d0f37 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:05.549727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-17a437c3-f497-46c7-a174-4831e80d0f37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:05.604486 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a437c3-f497-46c7-a174-4831e80d0f37 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:05.608226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059f43c-0b74-416f-884a-5b0d9edb7fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:05.608862 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f43c-0b74-416f-884a-5b0d9edb7fbd service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:05.609148 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f43c-0b74-416f-884a-5b0d9edb7fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:05.609427 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059f43c-0b74-416f-884a-5b0d9edb7fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:05.611169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b059f43c-0b74-416f-884a-5b0d9edb7fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:05.620288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059f43c-0b74-416f-884a-5b0d9edb7fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:05.621713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059f43c-0b74-416f-884a-5b0d9edb7fbd service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:05.629914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1305/2568] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:34:05 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:34:09.913758 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f219d7f-ea63-4db2-8bd6-772378e0c959 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:09.975947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f219d7f-ea63-4db2-8bd6-772378e0c959 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:09.980469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:09.981330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:09.981615 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:09.981896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] PATH_INFO: `/v3/users/c34c8482bb2d4354b204ac25eb50436d` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:09.983118 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34c8482bb2d4354b204ac25eb50436d)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:09.985540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:10.030362 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34c8482bb2d4354b204ac25eb50436d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.037139 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34c8482bb2d4354b204ac25eb50436d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.037787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34c8482bb2d4354b204ac25eb50436d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.038385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34c8482bb2d4354b204ac25eb50436d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.045349 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34c8482bb2d4354b204ac25eb50436d'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.062252 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1264/2569] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:34:09 2021] DELETE /identity/v3/users/c34c8482bb2d4354b204ac25eb50436d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:10.066768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53da263-d669-42fd-98c9-6a7623057e34 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:10.067263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53da263-d669-42fd-98c9-6a7623057e34 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:10.067371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53da263-d669-42fd-98c9-6a7623057e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:10.084352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-e53da263-d669-42fd-98c9-6a7623057e34 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:10.085546 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e53da263-d669-42fd-98c9-6a7623057e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:10.142771 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1306/2570] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:10.152598 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:10.154018 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:10.209398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2478519-7d02-45d6-a920-408b4f79f537 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:10.213224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb39f83-55f4-4e1c-a1b9-b0e2abfe485e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:10.213906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb39f83-55f4-4e1c-a1b9-b0e2abfe485e service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:10.214188 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb39f83-55f4-4e1c-a1b9-b0e2abfe485e service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:10.214582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb39f83-55f4-4e1c-a1b9-b0e2abfe485e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:10.224208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb39f83-55f4-4e1c-a1b9-b0e2abfe485e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:10.225659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb39f83-55f4-4e1c-a1b9-b0e2abfe485e service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:10.235704 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1265/2571] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:34:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:34:10.512583 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53da263-d669-42fd-98c9-6a7623057e34 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:10.514365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e53da263-d669-42fd-98c9-6a7623057e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:10.530306 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53da263-d669-42fd-98c9-6a7623057e34 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:10.536715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:10.537574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:10.537850 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:10.538119 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] PATH_INFO: `/v3/projects/2670b0784e764b02b7ccff5044922447` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:10.539318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2670b0784e764b02b7ccff5044922447)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:10.541205 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:10.586801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2670b0784e764b02b7ccff5044922447', 'request_id': 'req-8fa8851b-b81c-419e-9c86-40646c922e53'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.592966 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2670b0784e764b02b7ccff5044922447', 'request_id': 'req-8fa8851b-b81c-419e-9c86-40646c922e53'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.598818 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2670b0784e764b02b7ccff5044922447', 'request_id': 'req-8fa8851b-b81c-419e-9c86-40646c922e53'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.610495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] The token cache is being invalidate because project 2670b0784e764b02b7ccff5044922447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:34:10.610883 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.611502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.613009 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1307/2572] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:34:10 2021] DELETE /identity/v3/projects/2670b0784e764b02b7ccff5044922447 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:10.617010 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb39f83-55f4-4e1c-a1b9-b0e2abfe485e service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:10.626301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb39f83-55f4-4e1c-a1b9-b0e2abfe485e service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:10.679595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:10.680440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:10.680726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:10.681004 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] PATH_INFO: `/v3/users/47973ed7fa284187bde3996dbe4218c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:10.682167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=47973ed7fa284187bde3996dbe4218c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:10.684097 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:10.727640 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47973ed7fa284187bde3996dbe4218c2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.734153 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47973ed7fa284187bde3996dbe4218c2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.734833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47973ed7fa284187bde3996dbe4218c2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.735436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47973ed7fa284187bde3996dbe4218c2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.743043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-29b2ffb7-1596-4f3f-809b-01431198b7ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47973ed7fa284187bde3996dbe4218c2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:10.759107 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1266/2573] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:34:10 2021] DELETE /identity/v3/users/47973ed7fa284187bde3996dbe4218c2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:11.028533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.029965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:11.046297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8851b-b81c-419e-9c86-40646c922e53 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.100515 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.101369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.101653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.101928 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] PATH_INFO: `/v3/projects/a5c404523c37432aa17c4f33e090708e` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.103102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c404523c37432aa17c4f33e090708e)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.105031 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:11.150458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c404523c37432aa17c4f33e090708e', 'request_id': 'req-2dd14154-2846-489e-b39a-45c83289d184'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:11.156452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c404523c37432aa17c4f33e090708e', 'request_id': 'req-2dd14154-2846-489e-b39a-45c83289d184'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:11.161567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c404523c37432aa17c4f33e090708e', 'request_id': 'req-2dd14154-2846-489e-b39a-45c83289d184'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:11.173678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] The token cache is being invalidate because project a5c404523c37432aa17c4f33e090708e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:34:11.173975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:11.174590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-2dd14154-2846-489e-b39a-45c83289d184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:11.176151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1308/2574] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:34:11 2021] DELETE /identity/v3/projects/a5c404523c37432aa17c4f33e090708e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:11.185324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a927e11-45e0-4d8e-81bc-6d54189be275 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.185812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a927e11-45e0-4d8e-81bc-6d54189be275 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.185980 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a927e11-45e0-4d8e-81bc-6d54189be275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.204334 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-6a927e11-45e0-4d8e-81bc-6d54189be275 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:11.205517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6a927e11-45e0-4d8e-81bc-6d54189be275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:11.266861 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1267/2575] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:11.274175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e980e-e4f3-483b-afc6-a7934a3c21c0 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.274467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e980e-e4f3-483b-afc6-a7934a3c21c0 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.274782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e980e-e4f3-483b-afc6-a7934a3c21c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.292263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-677e980e-e4f3-483b-afc6-a7934a3c21c0 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:11.293458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-677e980e-e4f3-483b-afc6-a7934a3c21c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:11.301682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1309/2576] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:11.305616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a927e11-45e0-4d8e-81bc-6d54189be275 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.315482 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a927e11-45e0-4d8e-81bc-6d54189be275 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.319937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32159947-042a-4e3c-9380-58246a567e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.320573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32159947-042a-4e3c-9380-58246a567e44 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.320855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32159947-042a-4e3c-9380-58246a567e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.321131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32159947-042a-4e3c-9380-58246a567e44 admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.321840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32159947-042a-4e3c-9380-58246a567e44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:34:11.322142 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32159947-042a-4e3c-9380-58246a567e44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.323745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32159947-042a-4e3c-9380-58246a567e44 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:11.335020 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1268/2577] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:34:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 01:34:11.339280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e980e-e4f3-483b-afc6-a7934a3c21c0 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.348159 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e980e-e4f3-483b-afc6-a7934a3c21c0 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.352769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90c058-9d97-4347-bf9d-3c0e226ba3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.353406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90c058-9d97-4347-bf9d-3c0e226ba3aa admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.353691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90c058-9d97-4347-bf9d-3c0e226ba3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.353969 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90c058-9d97-4347-bf9d-3c0e226ba3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.354643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90c058-9d97-4347-bf9d-3c0e226ba3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.356565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90c058-9d97-4347-bf9d-3c0e226ba3aa admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:11.390618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1310/2578] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:34:11 2021] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:34:11.394557 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32159947-042a-4e3c-9380-58246a567e44 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.404199 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32159947-042a-4e3c-9380-58246a567e44 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.458129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b002926-4929-417e-b5e7-5c3d06d20b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.458827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b002926-4929-417e-b5e7-5c3d06d20b30 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.459143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b002926-4929-417e-b5e7-5c3d06d20b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.459424 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b002926-4929-417e-b5e7-5c3d06d20b30 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.460131 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b002926-4929-417e-b5e7-5c3d06d20b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.462054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b002926-4929-417e-b5e7-5c3d06d20b30 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:11.480642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1269/2579] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:34:11 2021] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:34:11.484689 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90c058-9d97-4347-bf9d-3c0e226ba3aa admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.495601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90c058-9d97-4347-bf9d-3c0e226ba3aa admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.500367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c67fc-75c9-4885-a052-00a3d49d6b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.501649 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c67fc-75c9-4885-a052-00a3d49d6b7c admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.501931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c67fc-75c9-4885-a052-00a3d49d6b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.502229 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c67fc-75c9-4885-a052-00a3d49d6b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.502979 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c67fc-75c9-4885-a052-00a3d49d6b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.504596 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c67fc-75c9-4885-a052-00a3d49d6b7c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:11.514659 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1311/2580] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:34:11.519037 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b002926-4929-417e-b5e7-5c3d06d20b30 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.530576 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b002926-4929-417e-b5e7-5c3d06d20b30 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.535694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75697c5-58fa-43fc-af6b-7adfa2bcbb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.536341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75697c5-58fa-43fc-af6b-7adfa2bcbb02 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.536623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75697c5-58fa-43fc-af6b-7adfa2bcbb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.536900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75697c5-58fa-43fc-af6b-7adfa2bcbb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.537625 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75697c5-58fa-43fc-af6b-7adfa2bcbb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.539234 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75697c5-58fa-43fc-af6b-7adfa2bcbb02 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:11.549415 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1270/2581] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:34:11.553298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c67fc-75c9-4885-a052-00a3d49d6b7c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.563142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c67fc-75c9-4885-a052-00a3d49d6b7c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.567663 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1581651-fe62-42ba-b4e7-7f69ec15b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.568523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581651-fe62-42ba-b4e7-7f69ec15b8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.568801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581651-fe62-42ba-b4e7-7f69ec15b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.569077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581651-fe62-42ba-b4e7-7f69ec15b8b3 admin admin] PATH_INFO: `/v3/projects/3192a03629bf4a7e9ca3dfea6760c6d0/users/67c0c44e5fa34879846ab3642abf00f7/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.583010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1581651-fe62-42ba-b4e7-7f69ec15b8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3192a03629bf4a7e9ca3dfea6760c6d0, user_id=67c0c44e5fa34879846ab3642abf00f7, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.585631 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1581651-fe62-42ba-b4e7-7f69ec15b8b3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:11.598998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1312/2582] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:34:11 2021] PUT /identity/v3/projects/3192a03629bf4a7e9ca3dfea6760c6d0/users/67c0c44e5fa34879846ab3642abf00f7/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:34:11.609775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670a1e-4fb9-42d6-a413-76a4c7ea4feb None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.610763 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670a1e-4fb9-42d6-a413-76a4c7ea4feb None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.611046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670a1e-4fb9-42d6-a413-76a4c7ea4feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.638135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-a5670a1e-4fb9-42d6-a413-76a4c7ea4feb None None] MFA Rules not processed for user `67c0c44e5fa34879846ab3642abf00f7`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:11.639371 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a5670a1e-4fb9-42d6-a413-76a4c7ea4feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:11.703051 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1271/2583] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:11 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:11.707333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1581651-fe62-42ba-b4e7-7f69ec15b8b3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.768654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1581651-fe62-42ba-b4e7-7f69ec15b8b3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.775011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb656d7c-8380-4c48-8d0b-7850a8916666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.775904 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb656d7c-8380-4c48-8d0b-7850a8916666 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.776191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb656d7c-8380-4c48-8d0b-7850a8916666 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.776468 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb656d7c-8380-4c48-8d0b-7850a8916666 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.777267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb656d7c-8380-4c48-8d0b-7850a8916666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.779191 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb656d7c-8380-4c48-8d0b-7850a8916666 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:11.806754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1313/2584] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:34:11 2021] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:34:11.811510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5670a1e-4fb9-42d6-a413-76a4c7ea4feb None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.823052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5670a1e-4fb9-42d6-a413-76a4c7ea4feb None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.879377 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac68e47-2a7f-4e86-b9a5-2df5b76a825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.880048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac68e47-2a7f-4e86-b9a5-2df5b76a825a admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.880334 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac68e47-2a7f-4e86-b9a5-2df5b76a825a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.880614 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac68e47-2a7f-4e86-b9a5-2df5b76a825a admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.881296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac68e47-2a7f-4e86-b9a5-2df5b76a825a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.883298 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac68e47-2a7f-4e86-b9a5-2df5b76a825a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:11.909158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1272/2585] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:34:11 2021] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:34:11.910533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb656d7c-8380-4c48-8d0b-7850a8916666 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.922180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb656d7c-8380-4c48-8d0b-7850a8916666 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.928067 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f66c3f-23d3-4385-95aa-dea559789b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.928860 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f66c3f-23d3-4385-95aa-dea559789b97 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.929148 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f66c3f-23d3-4385-95aa-dea559789b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.929423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f66c3f-23d3-4385-95aa-dea559789b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.930145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f66c3f-23d3-4385-95aa-dea559789b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.932001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f66c3f-23d3-4385-95aa-dea559789b97 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:11.946817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1314/2586] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:11 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:34:11.948361 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac68e47-2a7f-4e86-b9a5-2df5b76a825a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:11.959995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac68e47-2a7f-4e86-b9a5-2df5b76a825a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:11.965919 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e010f-31b4-485a-be58-54eba589e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:11.966833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e010f-31b4-485a-be58-54eba589e0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:11.967802 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e010f-31b4-485a-be58-54eba589e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:11.968083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e010f-31b4-485a-be58-54eba589e0a5 admin admin] PATH_INFO: `/v3/projects/2cadf96ff091493c8103bb73f2b6233c/users/54d59f0943dc46298e7f7c1c26003315/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:11.985383 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e010f-31b4-485a-be58-54eba589e0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cadf96ff091493c8103bb73f2b6233c, user_id=54d59f0943dc46298e7f7c1c26003315, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:11.990081 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e010f-31b4-485a-be58-54eba589e0a5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:12.003209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1273/2587] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:34:11 2021] PUT /identity/v3/projects/2cadf96ff091493c8103bb73f2b6233c/users/54d59f0943dc46298e7f7c1c26003315/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:12.007517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f66c3f-23d3-4385-95aa-dea559789b97 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:12.018592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f66c3f-23d3-4385-95aa-dea559789b97 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:12.074294 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbff0a-e6f8-4654-af67-a2af77e0d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:12.075010 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbff0a-e6f8-4654-af67-a2af77e0d758 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:12.075297 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbff0a-e6f8-4654-af67-a2af77e0d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:12.075572 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbff0a-e6f8-4654-af67-a2af77e0d758 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:12.076315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbff0a-e6f8-4654-af67-a2af77e0d758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:12.077934 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbff0a-e6f8-4654-af67-a2af77e0d758 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:12.089011 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1315/2588] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:12 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:34:12.093099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e010f-31b4-485a-be58-54eba589e0a5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:12.103871 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e010f-31b4-485a-be58-54eba589e0a5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:12.108548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ae058-1804-40c0-8108-4a35b019f140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:12.109427 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ae058-1804-40c0-8108-4a35b019f140 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:12.109712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ae058-1804-40c0-8108-4a35b019f140 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:12.110082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ae058-1804-40c0-8108-4a35b019f140 admin admin] PATH_INFO: `/v3/projects/2cadf96ff091493c8103bb73f2b6233c/users/54d59f0943dc46298e7f7c1c26003315/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:12.112027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ae058-1804-40c0-8108-4a35b019f140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cadf96ff091493c8103bb73f2b6233c, user_id=54d59f0943dc46298e7f7c1c26003315, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:12.114851 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ae058-1804-40c0-8108-4a35b019f140 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:12.127267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1274/2589] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:34:12 2021] PUT /identity/v3/projects/2cadf96ff091493c8103bb73f2b6233c/users/54d59f0943dc46298e7f7c1c26003315/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:12.140628 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09376d42-8009-4b0a-8e1d-ca8c1a807638 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:12.141623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09376d42-8009-4b0a-8e1d-ca8c1a807638 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:12.141914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09376d42-8009-4b0a-8e1d-ca8c1a807638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:12.170957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-09376d42-8009-4b0a-8e1d-ca8c1a807638 None None] MFA Rules not processed for user `54d59f0943dc46298e7f7c1c26003315`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:12.175283 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-09376d42-8009-4b0a-8e1d-ca8c1a807638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:12.237680 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1316/2590] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:12 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:12.247401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ae058-1804-40c0-8108-4a35b019f140 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:12.249165 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f66ae058-1804-40c0-8108-4a35b019f140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:12.303972 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ae058-1804-40c0-8108-4a35b019f140 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:12.307569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5b235-9511-445e-ab08-c963abec8646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:12.308196 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b235-9511-445e-ab08-c963abec8646 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:12.308481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b235-9511-445e-ab08-c963abec8646 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:12.308761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b235-9511-445e-ab08-c963abec8646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:12.317818 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5b235-9511-445e-ab08-c963abec8646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:12.319269 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5b235-9511-445e-ab08-c963abec8646 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:12.329098 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1275/2591] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:34:12 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:34:12.814160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09376d42-8009-4b0a-8e1d-ca8c1a807638 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:12.876046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09376d42-8009-4b0a-8e1d-ca8c1a807638 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:12.880675 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:12.881536 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:12.881819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:12.882097 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] PATH_INFO: `/v3/users/67c0c44e5fa34879846ab3642abf00f7` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:12.883408 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c0c44e5fa34879846ab3642abf00f7)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:12.885307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:12.932598 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c0c44e5fa34879846ab3642abf00f7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:12.943773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c0c44e5fa34879846ab3642abf00f7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:12.944419 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c0c44e5fa34879846ab3642abf00f7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:12.950872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c0c44e5fa34879846ab3642abf00f7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:12.951487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c0c44e5fa34879846ab3642abf00f7'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:12.964103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1317/2592] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:34:12 2021] DELETE /identity/v3/users/67c0c44e5fa34879846ab3642abf00f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:34:12.968755 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e85df-6fc6-4aaa-b755-185faf3548d8 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:12.969044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e85df-6fc6-4aaa-b755-185faf3548d8 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:12.969904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e85df-6fc6-4aaa-b755-185faf3548d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:12.987497 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-e24e85df-6fc6-4aaa-b755-185faf3548d8 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:12.988680 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e24e85df-6fc6-4aaa-b755-185faf3548d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:13.046270 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1276/2593] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:34:13.056333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:13.057815 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:13.115470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090d5a-405c-4c26-b4b4-9890eaf5f2d8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:13.120496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a606b7-a648-4f89-836c-92bd6deeb709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:13.121177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a606b7-a648-4f89-836c-92bd6deeb709 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:13.121458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a606b7-a648-4f89-836c-92bd6deeb709 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:13.121738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a606b7-a648-4f89-836c-92bd6deeb709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:13.131643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a606b7-a648-4f89-836c-92bd6deeb709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:13.133115 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a606b7-a648-4f89-836c-92bd6deeb709 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:13.143452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1318/2594] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:34:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:34:13.417889 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e85df-6fc6-4aaa-b755-185faf3548d8 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:13.419332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e24e85df-6fc6-4aaa-b755-185faf3548d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:13.431531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e85df-6fc6-4aaa-b755-185faf3548d8 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:13.436324 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:13.437168 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:13.437447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:13.437722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] PATH_INFO: `/v3/projects/3192a03629bf4a7e9ca3dfea6760c6d0` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:13.439646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3192a03629bf4a7e9ca3dfea6760c6d0)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:13.441533 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:13.487055 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3192a03629bf4a7e9ca3dfea6760c6d0', 'request_id': 'req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:13.493688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3192a03629bf4a7e9ca3dfea6760c6d0', 'request_id': 'req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:13.499017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3192a03629bf4a7e9ca3dfea6760c6d0', 'request_id': 'req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:13.512194 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] The token cache is being invalidate because project 3192a03629bf4a7e9ca3dfea6760c6d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:34:13.512481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:13.513670 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:13.515714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1277/2595] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:34:13 2021] DELETE /identity/v3/projects/3192a03629bf4a7e9ca3dfea6760c6d0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:13.519863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a606b7-a648-4f89-836c-92bd6deeb709 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:13.529230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a606b7-a648-4f89-836c-92bd6deeb709 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:13.581758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:13.582538 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:13.582850 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:13.583125 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] PATH_INFO: `/v3/users/54d59f0943dc46298e7f7c1c26003315` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:13.584283 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d59f0943dc46298e7f7c1c26003315)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:13.586177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:13.630931 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d59f0943dc46298e7f7c1c26003315'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:13.643012 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d59f0943dc46298e7f7c1c26003315'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:13.644809 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d59f0943dc46298e7f7c1c26003315'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:13.651150 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d59f0943dc46298e7f7c1c26003315'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:13.651800 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-55c9a5bf-bb3f-40b3-9d3f-7ee3020388ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d59f0943dc46298e7f7c1c26003315'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:13.664632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1319/2596] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:34:13 2021] DELETE /identity/v3/users/54d59f0943dc46298e7f7c1c26003315 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:13.941132 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:13.951750 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:13.967179 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c66b5-440d-4e1c-a3e7-412cf1479b33 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.025323 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.026524 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.026869 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.027275 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] PATH_INFO: `/v3/projects/2cadf96ff091493c8103bb73f2b6233c` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.028463 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cadf96ff091493c8103bb73f2b6233c)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.030384 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.076138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cadf96ff091493c8103bb73f2b6233c', 'request_id': 'req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:14.082706 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cadf96ff091493c8103bb73f2b6233c', 'request_id': 'req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:14.087964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cadf96ff091493c8103bb73f2b6233c', 'request_id': 'req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:14.100639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] The token cache is being invalidate because project 2cadf96ff091493c8103bb73f2b6233c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:34:14.100965 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:14.101593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0573f9ea-9eb1-4dd9-aae7-78e4e5548db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:14.103151 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1278/2597] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:34:13 2021] DELETE /identity/v3/projects/2cadf96ff091493c8103bb73f2b6233c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:14.111995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e765b1-4987-4fbe-ac94-cc167d884ef5 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.112365 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e765b1-4987-4fbe-ac94-cc167d884ef5 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.112652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e765b1-4987-4fbe-ac94-cc167d884ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.131495 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-47e765b1-4987-4fbe-ac94-cc167d884ef5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:14.132577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-47e765b1-4987-4fbe-ac94-cc167d884ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:14.192251 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1320/2598] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:14.199908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129436de-5edb-4faf-93b3-815075bdcd2b None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.200198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129436de-5edb-4faf-93b3-815075bdcd2b None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.200475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129436de-5edb-4faf-93b3-815075bdcd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.218014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-129436de-5edb-4faf-93b3-815075bdcd2b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:14.219266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-129436de-5edb-4faf-93b3-815075bdcd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:14.226948 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1279/2599] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:14.231414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e765b1-4987-4fbe-ac94-cc167d884ef5 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.240926 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e765b1-4987-4fbe-ac94-cc167d884ef5 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.245494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fc6e3-2fb0-406c-b3dd-fd4350248b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.246145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fc6e3-2fb0-406c-b3dd-fd4350248b9d admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.246424 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fc6e3-2fb0-406c-b3dd-fd4350248b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.246719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fc6e3-2fb0-406c-b3dd-fd4350248b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.247437 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fc6e3-2fb0-406c-b3dd-fd4350248b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:34:14.247743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fc6e3-2fb0-406c-b3dd-fd4350248b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.249329 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fc6e3-2fb0-406c-b3dd-fd4350248b9d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.261727 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1321/2600] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:34:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:34:14.265957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129436de-5edb-4faf-93b3-815075bdcd2b None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.275014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129436de-5edb-4faf-93b3-815075bdcd2b None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.279769 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe4ada-f263-4772-988e-04df06699f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.280424 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe4ada-f263-4772-988e-04df06699f76 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.280709 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe4ada-f263-4772-988e-04df06699f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.280988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe4ada-f263-4772-988e-04df06699f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.281744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe4ada-f263-4772-988e-04df06699f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.283675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe4ada-f263-4772-988e-04df06699f76 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.309452 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1280/2601] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:34:14 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:34:14.314373 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fc6e3-2fb0-406c-b3dd-fd4350248b9d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.324895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fc6e3-2fb0-406c-b3dd-fd4350248b9d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.379839 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df06862-8f2a-4965-ab5e-619b38c42dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.380509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06862-8f2a-4965-ab5e-619b38c42dfc admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.380791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06862-8f2a-4965-ab5e-619b38c42dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.381095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06862-8f2a-4965-ab5e-619b38c42dfc admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.381830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df06862-8f2a-4965-ab5e-619b38c42dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.383718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df06862-8f2a-4965-ab5e-619b38c42dfc admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.406075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1322/2602] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:34:14 2021] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:34:14.407386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe4ada-f263-4772-988e-04df06699f76 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.417285 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe4ada-f263-4772-988e-04df06699f76 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.422638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc28849-aba1-4264-9ad0-2d60cb85333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.423358 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc28849-aba1-4264-9ad0-2d60cb85333d admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.423634 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc28849-aba1-4264-9ad0-2d60cb85333d admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.423928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc28849-aba1-4264-9ad0-2d60cb85333d admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.424646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc28849-aba1-4264-9ad0-2d60cb85333d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.426248 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc28849-aba1-4264-9ad0-2d60cb85333d admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.436550 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1281/2603] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:34:14.441141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df06862-8f2a-4965-ab5e-619b38c42dfc admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.451300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df06862-8f2a-4965-ab5e-619b38c42dfc admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.456230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c11804-7072-4124-a875-ac1c89fcb879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.456965 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c11804-7072-4124-a875-ac1c89fcb879 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.457321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c11804-7072-4124-a875-ac1c89fcb879 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.457714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c11804-7072-4124-a875-ac1c89fcb879 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.458937 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c11804-7072-4124-a875-ac1c89fcb879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.460200 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c11804-7072-4124-a875-ac1c89fcb879 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.471592 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1323/2604] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:34:14.475707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc28849-aba1-4264-9ad0-2d60cb85333d admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.486354 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc28849-aba1-4264-9ad0-2d60cb85333d admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.491738 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8e87-aa3d-4fa9-8e55-6b069e226891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.492705 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8e87-aa3d-4fa9-8e55-6b069e226891 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.493083 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8e87-aa3d-4fa9-8e55-6b069e226891 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.493430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8e87-aa3d-4fa9-8e55-6b069e226891 admin admin] PATH_INFO: `/v3/projects/75d8ddebf15a44189d8b15fcb7153f98/users/81fd862ba30f467b8ef1d21aa7e2000a/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.511233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f8e87-aa3d-4fa9-8e55-6b069e226891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d8ddebf15a44189d8b15fcb7153f98, user_id=81fd862ba30f467b8ef1d21aa7e2000a, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.513971 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f8e87-aa3d-4fa9-8e55-6b069e226891 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.527372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1282/2605] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:34:14 2021] PUT /identity/v3/projects/75d8ddebf15a44189d8b15fcb7153f98/users/81fd862ba30f467b8ef1d21aa7e2000a/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:34:14.539078 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2dd57-6192-4ede-be65-652e2faab8a7 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.539372 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2dd57-6192-4ede-be65-652e2faab8a7 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.539648 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2dd57-6192-4ede-be65-652e2faab8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.566033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-35e2dd57-6192-4ede-be65-652e2faab8a7 None None] MFA Rules not processed for user `81fd862ba30f467b8ef1d21aa7e2000a`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:14.567273 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-35e2dd57-6192-4ede-be65-652e2faab8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:14.629718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1324/2606] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:14 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:14.634353 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8e87-aa3d-4fa9-8e55-6b069e226891 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.696167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8e87-aa3d-4fa9-8e55-6b069e226891 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.700839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5fb87-9f9f-4c0b-8b18-839c5d1b117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.701491 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5fb87-9f9f-4c0b-8b18-839c5d1b117c admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.701775 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5fb87-9f9f-4c0b-8b18-839c5d1b117c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.702046 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5fb87-9f9f-4c0b-8b18-839c5d1b117c admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.702764 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5fb87-9f9f-4c0b-8b18-839c5d1b117c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.704673 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5fb87-9f9f-4c0b-8b18-839c5d1b117c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.730266 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1283/2607] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:34:14 2021] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:34:14.734367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2dd57-6192-4ede-be65-652e2faab8a7 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.745470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2dd57-6192-4ede-be65-652e2faab8a7 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.801042 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fc865-95ce-4145-a4ee-696f4240a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.801711 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fc865-95ce-4145-a4ee-696f4240a117 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.801993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fc865-95ce-4145-a4ee-696f4240a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.802267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fc865-95ce-4145-a4ee-696f4240a117 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.802971 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fc865-95ce-4145-a4ee-696f4240a117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.804964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fc865-95ce-4145-a4ee-696f4240a117 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.824667 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1325/2608] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:34:14 2021] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:34:14.828756 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5fb87-9f9f-4c0b-8b18-839c5d1b117c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.838926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5fb87-9f9f-4c0b-8b18-839c5d1b117c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.843495 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9958744-d930-4544-8b85-3d65b53ac4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.844688 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958744-d930-4544-8b85-3d65b53ac4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.844968 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958744-d930-4544-8b85-3d65b53ac4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.845241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958744-d930-4544-8b85-3d65b53ac4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.846224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9958744-d930-4544-8b85-3d65b53ac4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.847826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9958744-d930-4544-8b85-3d65b53ac4f5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.861777 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1284/2609] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:14 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:34:14.865776 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fc865-95ce-4145-a4ee-696f4240a117 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.876048 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fc865-95ce-4145-a4ee-696f4240a117 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.880654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fb34f-765e-4803-83a2-b0b51328c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.881530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fb34f-765e-4803-83a2-b0b51328c2fb admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.881813 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fb34f-765e-4803-83a2-b0b51328c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.882088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fb34f-765e-4803-83a2-b0b51328c2fb admin admin] PATH_INFO: `/v3/projects/a5bd513034384e9fb7d53fd252b46c65/users/e5c4a0cb731c48d7a2d9283a61b76fdb/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.897438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fb34f-765e-4803-83a2-b0b51328c2fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5bd513034384e9fb7d53fd252b46c65, user_id=e5c4a0cb731c48d7a2d9283a61b76fdb, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.900157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fb34f-765e-4803-83a2-b0b51328c2fb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.915560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1326/2610] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:34:14 2021] PUT /identity/v3/projects/a5bd513034384e9fb7d53fd252b46c65/users/e5c4a0cb731c48d7a2d9283a61b76fdb/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:34:14.919469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9958744-d930-4544-8b85-3d65b53ac4f5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:14.929450 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9958744-d930-4544-8b85-3d65b53ac4f5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:14.985091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f64ad1-c156-43f1-89f5-7f02a7601e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:14.985762 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f64ad1-c156-43f1-89f5-7f02a7601e87 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:14.986159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f64ad1-c156-43f1-89f5-7f02a7601e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:14.986448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f64ad1-c156-43f1-89f5-7f02a7601e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:14.987341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f64ad1-c156-43f1-89f5-7f02a7601e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:14.988953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f64ad1-c156-43f1-89f5-7f02a7601e87 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:14.999308 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1285/2611] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:14 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:34:15.003351 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fb34f-765e-4803-83a2-b0b51328c2fb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:15.013995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fb34f-765e-4803-83a2-b0b51328c2fb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:15.019442 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737ff4c-8aba-4869-b577-086cff2d3765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:15.020336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737ff4c-8aba-4869-b577-086cff2d3765 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:15.020627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737ff4c-8aba-4869-b577-086cff2d3765 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:15.020906 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737ff4c-8aba-4869-b577-086cff2d3765 admin admin] PATH_INFO: `/v3/projects/a5bd513034384e9fb7d53fd252b46c65/users/e5c4a0cb731c48d7a2d9283a61b76fdb/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:15.022913 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737ff4c-8aba-4869-b577-086cff2d3765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5bd513034384e9fb7d53fd252b46c65, user_id=e5c4a0cb731c48d7a2d9283a61b76fdb, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:15.025668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737ff4c-8aba-4869-b577-086cff2d3765 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:15.036719 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1327/2612] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:34:15 2021] PUT /identity/v3/projects/a5bd513034384e9fb7d53fd252b46c65/users/e5c4a0cb731c48d7a2d9283a61b76fdb/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:34:15.046706 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d71c-742e-4367-839f-bbe2b3506d33 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:15.047017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d71c-742e-4367-839f-bbe2b3506d33 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:15.047315 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d71c-742e-4367-839f-bbe2b3506d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:15.072687 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-7ba3d71c-742e-4367-839f-bbe2b3506d33 None None] MFA Rules not processed for user `e5c4a0cb731c48d7a2d9283a61b76fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:15.073979 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7ba3d71c-742e-4367-839f-bbe2b3506d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:15.178052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1286/2613] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:15 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:34:15.192554 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737ff4c-8aba-4869-b577-086cff2d3765 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:15.195271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a737ff4c-8aba-4869-b577-086cff2d3765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:15.259123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737ff4c-8aba-4869-b577-086cff2d3765 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:15.263103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f6cc3-b177-4bba-a23c-dcd3b4d052a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:15.263754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f6cc3-b177-4bba-a23c-dcd3b4d052a1 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:15.264033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f6cc3-b177-4bba-a23c-dcd3b4d052a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:15.264315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f6cc3-b177-4bba-a23c-dcd3b4d052a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:15.323712 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f6cc3-b177-4bba-a23c-dcd3b4d052a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:15.325302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f6cc3-b177-4bba-a23c-dcd3b4d052a1 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:15.336185 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1328/2614] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:34:15 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:34:19.543638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3d71c-742e-4367-839f-bbe2b3506d33 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:19.545021 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-7ba3d71c-742e-4367-839f-bbe2b3506d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:19.558314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3d71c-742e-4367-839f-bbe2b3506d33 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:19.561880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eadbd-9232-4458-985f-75e9545025e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:19.562513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eadbd-9232-4458-985f-75e9545025e9 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:19.563437 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eadbd-9232-4458-985f-75e9545025e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:19.563715 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eadbd-9232-4458-985f-75e9545025e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:19.572526 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eadbd-9232-4458-985f-75e9545025e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:19.573940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eadbd-9232-4458-985f-75e9545025e9 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:19.585043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1287/2615] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:34:19 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:34:24.405491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f6cc3-b177-4bba-a23c-dcd3b4d052a1 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:24.463597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f6cc3-b177-4bba-a23c-dcd3b4d052a1 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:24.468023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:24.468892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:24.469170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:24.469445 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] PATH_INFO: `/v3/users/81fd862ba30f467b8ef1d21aa7e2000a` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:24.470617 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81fd862ba30f467b8ef1d21aa7e2000a)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:24.472587 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:24.520186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81fd862ba30f467b8ef1d21aa7e2000a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:24.531678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81fd862ba30f467b8ef1d21aa7e2000a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:24.532335 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81fd862ba30f467b8ef1d21aa7e2000a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:24.538905 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81fd862ba30f467b8ef1d21aa7e2000a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:24.539536 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81fd862ba30f467b8ef1d21aa7e2000a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:24.551688 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1329/2616] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:34:24 2021] DELETE /identity/v3/users/81fd862ba30f467b8ef1d21aa7e2000a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:24.556222 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42e55a-33bf-4d9c-a46c-136e4057ff37 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:24.556710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42e55a-33bf-4d9c-a46c-136e4057ff37 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:24.556832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42e55a-33bf-4d9c-a46c-136e4057ff37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:24.575341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-8d42e55a-33bf-4d9c-a46c-136e4057ff37 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:24.576531 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8d42e55a-33bf-4d9c-a46c-136e4057ff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:24.631114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1288/2617] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:24.642357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:24.643699 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:24.697560 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53d944-e22f-4f81-911d-720cf698df66 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:24.701330 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7a67b-1744-4d9b-80b2-689664324961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:24.701991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7a67b-1744-4d9b-80b2-689664324961 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:24.702277 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7a67b-1744-4d9b-80b2-689664324961 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:24.702555 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7a67b-1744-4d9b-80b2-689664324961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:24.711455 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7a67b-1744-4d9b-80b2-689664324961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:24.712878 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7a67b-1744-4d9b-80b2-689664324961 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:24.722243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1330/2618] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:34:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:34:24.988742 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42e55a-33bf-4d9c-a46c-136e4057ff37 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:24.990150 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8d42e55a-33bf-4d9c-a46c-136e4057ff37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:25.002513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42e55a-33bf-4d9c-a46c-136e4057ff37 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:25.007103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:25.007948 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:25.008224 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:25.008494 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] PATH_INFO: `/v3/projects/75d8ddebf15a44189d8b15fcb7153f98` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:25.009648 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d8ddebf15a44189d8b15fcb7153f98)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:25.011842 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:25.056106 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d8ddebf15a44189d8b15fcb7153f98', 'request_id': 'req-fc550cc2-30fd-4b33-9f33-b18bee882615'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.061890 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d8ddebf15a44189d8b15fcb7153f98', 'request_id': 'req-fc550cc2-30fd-4b33-9f33-b18bee882615'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.067062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d8ddebf15a44189d8b15fcb7153f98', 'request_id': 'req-fc550cc2-30fd-4b33-9f33-b18bee882615'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.078073 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] The token cache is being invalidate because project 75d8ddebf15a44189d8b15fcb7153f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:34:25.078359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.078979 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.080457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1289/2619] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:34:24 2021] DELETE /identity/v3/projects/75d8ddebf15a44189d8b15fcb7153f98 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:25.084533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7a67b-1744-4d9b-80b2-689664324961 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:25.094541 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7a67b-1744-4d9b-80b2-689664324961 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:25.147544 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:25.148394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:25.148676 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:25.148957 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] PATH_INFO: `/v3/users/e5c4a0cb731c48d7a2d9283a61b76fdb` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:25.150121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5c4a0cb731c48d7a2d9283a61b76fdb)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:25.152072 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:25.196018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5c4a0cb731c48d7a2d9283a61b76fdb'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.207627 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5c4a0cb731c48d7a2d9283a61b76fdb'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.208362 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5c4a0cb731c48d7a2d9283a61b76fdb'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.215138 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5c4a0cb731c48d7a2d9283a61b76fdb'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.215763 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-4fd0411b-3add-4c84-ae72-2efc4f54ce02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5c4a0cb731c48d7a2d9283a61b76fdb'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.227915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1331/2620] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:34:25 2021] DELETE /identity/v3/users/e5c4a0cb731c48d7a2d9283a61b76fdb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:25.497064 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:25.498490 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:25.511574 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc550cc2-30fd-4b33-9f33-b18bee882615 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:25.566943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:25.567827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:25.568108 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:25.568405 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] PATH_INFO: `/v3/projects/a5bd513034384e9fb7d53fd252b46c65` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:25.569562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5bd513034384e9fb7d53fd252b46c65)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:25.571487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:25.615248 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5bd513034384e9fb7d53fd252b46c65', 'request_id': 'req-07a839e6-2995-4b01-bd30-4447e4cfa1ec'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.621156 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5bd513034384e9fb7d53fd252b46c65', 'request_id': 'req-07a839e6-2995-4b01-bd30-4447e4cfa1ec'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.626484 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5bd513034384e9fb7d53fd252b46c65', 'request_id': 'req-07a839e6-2995-4b01-bd30-4447e4cfa1ec'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.638260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] The token cache is being invalidate because project a5bd513034384e9fb7d53fd252b46c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:34:25.638546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.639176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-07a839e6-2995-4b01-bd30-4447e4cfa1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:34:25.641197 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1290/2621] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:34:25 2021] DELETE /identity/v3/projects/a5bd513034384e9fb7d53fd252b46c65 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:25.648098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffaaf7-c3c0-49d1-8075-6fee8b0aa970 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:25.648578 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffaaf7-c3c0-49d1-8075-6fee8b0aa970 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:25.648672 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffaaf7-c3c0-49d1-8075-6fee8b0aa970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:25.666890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-22ffaaf7-c3c0-49d1-8075-6fee8b0aa970 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:25.668099 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-22ffaaf7-c3c0-49d1-8075-6fee8b0aa970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:25.729199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1332/2622] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:25.737735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7e6d-505a-4456-b6ef-d8b4ab08119f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:25.738030 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7e6d-505a-4456-b6ef-d8b4ab08119f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:25.738308 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7e6d-505a-4456-b6ef-d8b4ab08119f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:25.756662 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-5f9c7e6d-505a-4456-b6ef-d8b4ab08119f None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:25.757835 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5f9c7e6d-505a-4456-b6ef-d8b4ab08119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:25.766554 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1291/2623] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:25.770792 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffaaf7-c3c0-49d1-8075-6fee8b0aa970 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:25.780387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffaaf7-c3c0-49d1-8075-6fee8b0aa970 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:25.785566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a027-69d5-4611-8188-14c2894414b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:25.786220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a027-69d5-4611-8188-14c2894414b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:25.786503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a027-69d5-4611-8188-14c2894414b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:25.786830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a027-69d5-4611-8188-14c2894414b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:25.787710 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363a027-69d5-4611-8188-14c2894414b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:34:25.788017 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363a027-69d5-4611-8188-14c2894414b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:25.789597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363a027-69d5-4611-8188-14c2894414b7 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:25.800910 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1333/2624] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:34:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:34:25.805176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c7e6d-505a-4456-b6ef-d8b4ab08119f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:25.814732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c7e6d-505a-4456-b6ef-d8b4ab08119f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:25.819313 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381cb5f-ef29-4756-a3ed-446b7558cccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:25.819950 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381cb5f-ef29-4756-a3ed-446b7558cccb admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:25.820231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381cb5f-ef29-4756-a3ed-446b7558cccb admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:25.820506 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381cb5f-ef29-4756-a3ed-446b7558cccb admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:25.821190 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381cb5f-ef29-4756-a3ed-446b7558cccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:25.823105 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381cb5f-ef29-4756-a3ed-446b7558cccb admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:25.847346 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1292/2625] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:34:25 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:34:25.851439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a027-69d5-4611-8188-14c2894414b7 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:25.862188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a027-69d5-4611-8188-14c2894414b7 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:25.914445 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4786716-3b06-4cf2-a135-151fdcbfd2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:25.915123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4786716-3b06-4cf2-a135-151fdcbfd2eb admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:25.915406 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4786716-3b06-4cf2-a135-151fdcbfd2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:25.915686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4786716-3b06-4cf2-a135-151fdcbfd2eb admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:25.916353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4786716-3b06-4cf2-a135-151fdcbfd2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:25.918238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4786716-3b06-4cf2-a135-151fdcbfd2eb admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:25.936682 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1334/2626] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:34:25 2021] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:34:25.941240 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381cb5f-ef29-4756-a3ed-446b7558cccb admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:25.951527 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381cb5f-ef29-4756-a3ed-446b7558cccb admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:25.956696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361fcce-2b51-4741-8db6-60044a588ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:25.957356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361fcce-2b51-4741-8db6-60044a588ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:25.957639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361fcce-2b51-4741-8db6-60044a588ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:25.957917 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361fcce-2b51-4741-8db6-60044a588ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:25.958639 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361fcce-2b51-4741-8db6-60044a588ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:25.960249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361fcce-2b51-4741-8db6-60044a588ea0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:25.970910 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1293/2627] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:34:25.976267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4786716-3b06-4cf2-a135-151fdcbfd2eb admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:25.986334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4786716-3b06-4cf2-a135-151fdcbfd2eb admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:25.991615 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03a91d-0eee-4517-93d4-893bfbcdec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:25.992280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03a91d-0eee-4517-93d4-893bfbcdec82 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:25.992568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03a91d-0eee-4517-93d4-893bfbcdec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:25.992848 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03a91d-0eee-4517-93d4-893bfbcdec82 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:25.993566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03a91d-0eee-4517-93d4-893bfbcdec82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:25.995213 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03a91d-0eee-4517-93d4-893bfbcdec82 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:26.005576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1335/2628] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:34:26.009777 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361fcce-2b51-4741-8db6-60044a588ea0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:26.020413 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361fcce-2b51-4741-8db6-60044a588ea0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:26.025040 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718f7e0-ba6a-4abe-a549-1727ccec2630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:26.025903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f7e0-ba6a-4abe-a549-1727ccec2630 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:26.026184 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f7e0-ba6a-4abe-a549-1727ccec2630 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:26.026459 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f7e0-ba6a-4abe-a549-1727ccec2630 admin admin] PATH_INFO: `/v3/projects/bd502484c4f842cab183438793976e99/users/0b39db8c6d1a4a7591acabe30d1cc60b/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:26.040835 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718f7e0-ba6a-4abe-a549-1727ccec2630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd502484c4f842cab183438793976e99, user_id=0b39db8c6d1a4a7591acabe30d1cc60b, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:26.043595 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718f7e0-ba6a-4abe-a549-1727ccec2630 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:26.055889 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1294/2629] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:34:26 2021] PUT /identity/v3/projects/bd502484c4f842cab183438793976e99/users/0b39db8c6d1a4a7591acabe30d1cc60b/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:34:26.060759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beab424-977e-4ce0-8aa7-08834fe0ef3b None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:26.061077 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beab424-977e-4ce0-8aa7-08834fe0ef3b None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:26.061355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beab424-977e-4ce0-8aa7-08834fe0ef3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:26.079645 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-7beab424-977e-4ce0-8aa7-08834fe0ef3b None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:26.080825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7beab424-977e-4ce0-8aa7-08834fe0ef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:26.134653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1336/2630] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:34:26.145141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718f7e0-ba6a-4abe-a549-1727ccec2630 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:26.146805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f718f7e0-ba6a-4abe-a549-1727ccec2630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:26.199725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718f7e0-ba6a-4abe-a549-1727ccec2630 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:26.203271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c956065-0d29-4fa1-8db1-b6bba44b8251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:26.203888 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956065-0d29-4fa1-8db1-b6bba44b8251 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:26.204172 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956065-0d29-4fa1-8db1-b6bba44b8251 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:26.204446 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956065-0d29-4fa1-8db1-b6bba44b8251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:26.213008 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c956065-0d29-4fa1-8db1-b6bba44b8251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:26.214403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c956065-0d29-4fa1-8db1-b6bba44b8251 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:26.223436 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1295/2631] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:34:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:34:30.150127 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff721a-dc5e-4712-91ad-45968a1a1416 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:30.150664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff721a-dc5e-4712-91ad-45968a1a1416 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:30.150664 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff721a-dc5e-4712-91ad-45968a1a1416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:30.179283 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-d0ff721a-dc5e-4712-91ad-45968a1a1416 None None] MFA Rules not processed for user `0b39db8c6d1a4a7591acabe30d1cc60b`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:30.180514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d0ff721a-dc5e-4712-91ad-45968a1a1416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:30.244514 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1337/2632] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:30 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:34:30.248988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c956065-0d29-4fa1-8db1-b6bba44b8251 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:30.258629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c956065-0d29-4fa1-8db1-b6bba44b8251 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:30.263703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1236-6b8f-4e9c-950b-f75d0e5811d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:30.264378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1236-6b8f-4e9c-950b-f75d0e5811d8 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:30.264642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1236-6b8f-4e9c-950b-f75d0e5811d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:30.264931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1236-6b8f-4e9c-950b-f75d0e5811d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:30.266159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c1236-6b8f-4e9c-950b-f75d0e5811d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:30.268117 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c1236-6b8f-4e9c-950b-f75d0e5811d8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:30.297622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1296/2633] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:34:30 2021] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:34:30.301806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff721a-dc5e-4712-91ad-45968a1a1416 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:30.313438 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff721a-dc5e-4712-91ad-45968a1a1416 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:30.370706 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a5d8c-8f72-4392-bc3c-107fa9ba7e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:30.371791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a5d8c-8f72-4392-bc3c-107fa9ba7e69 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:30.372076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a5d8c-8f72-4392-bc3c-107fa9ba7e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:30.372467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a5d8c-8f72-4392-bc3c-107fa9ba7e69 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:30.373153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a5d8c-8f72-4392-bc3c-107fa9ba7e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:30.375634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a5d8c-8f72-4392-bc3c-107fa9ba7e69 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:30.398604 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1338/2634] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:34:30 2021] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:34:30.402631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1236-6b8f-4e9c-950b-f75d0e5811d8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:30.418229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1236-6b8f-4e9c-950b-f75d0e5811d8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:30.424844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a63f2d-af9a-453c-acdc-b1da8d83564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:30.425510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63f2d-af9a-453c-acdc-b1da8d83564c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:30.425796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63f2d-af9a-453c-acdc-b1da8d83564c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:30.426075 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63f2d-af9a-453c-acdc-b1da8d83564c admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:30.426840 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a63f2d-af9a-453c-acdc-b1da8d83564c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:30.428442 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a63f2d-af9a-453c-acdc-b1da8d83564c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:30.440737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1297/2635] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:30 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:34:30.444412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a5d8c-8f72-4392-bc3c-107fa9ba7e69 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:30.454942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a5d8c-8f72-4392-bc3c-107fa9ba7e69 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:30.459806 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03ddd7-c805-44c8-bdb1-072ed2168583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:30.460701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ddd7-c805-44c8-bdb1-072ed2168583 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:30.461027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ddd7-c805-44c8-bdb1-072ed2168583 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:30.461301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ddd7-c805-44c8-bdb1-072ed2168583 admin admin] PATH_INFO: `/v3/projects/4984e0fae1a848f8ae135a533cb4eba0/users/078edf1865c34157bab4f45a7beb24d9/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:30.475387 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03ddd7-c805-44c8-bdb1-072ed2168583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4984e0fae1a848f8ae135a533cb4eba0, user_id=078edf1865c34157bab4f45a7beb24d9, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:30.478066 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03ddd7-c805-44c8-bdb1-072ed2168583 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:30.491729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1339/2636] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:34:30 2021] PUT /identity/v3/projects/4984e0fae1a848f8ae135a533cb4eba0/users/078edf1865c34157bab4f45a7beb24d9/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:34:30.495676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a63f2d-af9a-453c-acdc-b1da8d83564c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:30.506581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a63f2d-af9a-453c-acdc-b1da8d83564c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:30.560733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b63f8-5635-48f1-86ce-e0452706ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:30.561394 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b63f8-5635-48f1-86ce-e0452706ca15 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:30.561679 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b63f8-5635-48f1-86ce-e0452706ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:30.561955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b63f8-5635-48f1-86ce-e0452706ca15 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:30.563207 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b63f8-5635-48f1-86ce-e0452706ca15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:30.564786 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b63f8-5635-48f1-86ce-e0452706ca15 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:30.574128 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1298/2637] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:34:30 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:34:30.578925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03ddd7-c805-44c8-bdb1-072ed2168583 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:30.588983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03ddd7-c805-44c8-bdb1-072ed2168583 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:30.593551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4582f-ea01-430f-9b2b-df4d56f11e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:30.594429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4582f-ea01-430f-9b2b-df4d56f11e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:30.594744 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4582f-ea01-430f-9b2b-df4d56f11e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:30.595027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4582f-ea01-430f-9b2b-df4d56f11e97 admin admin] PATH_INFO: `/v3/projects/4984e0fae1a848f8ae135a533cb4eba0/users/078edf1865c34157bab4f45a7beb24d9/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:30.596976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4582f-ea01-430f-9b2b-df4d56f11e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4984e0fae1a848f8ae135a533cb4eba0, user_id=078edf1865c34157bab4f45a7beb24d9, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:30.599652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4582f-ea01-430f-9b2b-df4d56f11e97 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:30.609633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1340/2638] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:34:30 2021] PUT /identity/v3/projects/4984e0fae1a848f8ae135a533cb4eba0/users/078edf1865c34157bab4f45a7beb24d9/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:34:34.707689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb4ee9-a38d-494d-b417-e6ffe7fbba3c None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:34.708272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb4ee9-a38d-494d-b417-e6ffe7fbba3c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:34.708272 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb4ee9-a38d-494d-b417-e6ffe7fbba3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:34.743325 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-78fb4ee9-a38d-494d-b417-e6ffe7fbba3c None None] MFA Rules not processed for user `078edf1865c34157bab4f45a7beb24d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:34.744699 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-78fb4ee9-a38d-494d-b417-e6ffe7fbba3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:34.830737 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1299/2639] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:34 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:34.841986 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4582f-ea01-430f-9b2b-df4d56f11e97 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:34.844452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b8e4582f-ea01-430f-9b2b-df4d56f11e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:34.911952 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4582f-ea01-430f-9b2b-df4d56f11e97 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:34.917394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a503-7147-4b3d-8ae6-29a043888f0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b9d35e26e64c959e075622321df3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:34.918346 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a503-7147-4b3d-8ae6-29a043888f0a service glance] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:34.918881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a503-7147-4b3d-8ae6-29a043888f0a service glance] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:34.919616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a503-7147-4b3d-8ae6-29a043888f0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:35.009893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868a503-7147-4b3d-8ae6-29a043888f0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:35.012268 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868a503-7147-4b3d-8ae6-29a043888f0a service glance] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:35.022919 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1341/2640] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:34:34 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:34:35.165402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f83346-50fd-4f3e-9f3e-330a68f92796 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:35.166063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f83346-50fd-4f3e-9f3e-330a68f92796 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:35.166369 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f83346-50fd-4f3e-9f3e-330a68f92796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:35.186633 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-13f83346-50fd-4f3e-9f3e-330a68f92796 None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:35.187925 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-13f83346-50fd-4f3e-9f3e-330a68f92796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:35.252684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1300/2641] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:34:35 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:35.310714 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a503-7147-4b3d-8ae6-29a043888f0a service glance] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:35.312280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9868a503-7147-4b3d-8ae6-29a043888f0a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:35.390407 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a503-7147-4b3d-8ae6-29a043888f0a service glance] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:35.396223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49797ed7-78f2-45ea-99fa-43262e1caffd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:35.396990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49797ed7-78f2-45ea-99fa-43262e1caffd service swift] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:35.397533 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49797ed7-78f2-45ea-99fa-43262e1caffd service swift] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:35.397997 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49797ed7-78f2-45ea-99fa-43262e1caffd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:35.407051 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49797ed7-78f2-45ea-99fa-43262e1caffd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:35.408673 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49797ed7-78f2-45ea-99fa-43262e1caffd service swift] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:35.418212 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1342/2642] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:34:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:34:44.337605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636f55-4bfe-48ee-b6de-433b8dc3878f None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:44.338114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636f55-4bfe-48ee-b6de-433b8dc3878f None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:44.338213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636f55-4bfe-48ee-b6de-433b8dc3878f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:44.355891 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-d8636f55-4bfe-48ee-b6de-433b8dc3878f None None] MFA Rules not processed for user `0b39db8c6d1a4a7591acabe30d1cc60b`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:44.357089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d8636f55-4bfe-48ee-b6de-433b8dc3878f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:44.363893 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1301/2643] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:34:44 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:46.069052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14f94-cc4a-4c94-9126-a78722b2e42a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:46.069557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14f94-cc4a-4c94-9126-a78722b2e42a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:46.069652 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14f94-cc4a-4c94-9126-a78722b2e42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:46.087350 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-dae14f94-cc4a-4c94-9126-a78722b2e42a None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:34:46.088565 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-dae14f94-cc4a-4c94-9126-a78722b2e42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:46.096247 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1343/2644] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:34:46 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:34:46.109900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8636f55-4bfe-48ee-b6de-433b8dc3878f None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:46.121943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8636f55-4bfe-48ee-b6de-433b8dc3878f None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:46.126926 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a111c-9ed4-4b0f-bab8-aa81a7ad6657 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:46.127568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a111c-9ed4-4b0f-bab8-aa81a7ad6657 service swift] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:46.127855 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a111c-9ed4-4b0f-bab8-aa81a7ad6657 service swift] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:46.128135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a111c-9ed4-4b0f-bab8-aa81a7ad6657 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:46.136400 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a111c-9ed4-4b0f-bab8-aa81a7ad6657 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:46.137976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a111c-9ed4-4b0f-bab8-aa81a7ad6657 service swift] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:46.145944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1302/2645] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:34:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:34:58.696825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae14f94-cc4a-4c94-9126-a78722b2e42a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:34:58.757758 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae14f94-cc4a-4c94-9126-a78722b2e42a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:34:58.762058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40a992-cece-4c04-9cab-75c8f140af08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:34:58.762743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40a992-cece-4c04-9cab-75c8f140af08 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:34:58.763038 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40a992-cece-4c04-9cab-75c8f140af08 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:34:58.763319 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40a992-cece-4c04-9cab-75c8f140af08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:34:58.765414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1b40a992-cece-4c04-9cab-75c8f140af08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:34:58.833404 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40a992-cece-4c04-9cab-75c8f140af08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:34:58.834871 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40a992-cece-4c04-9cab-75c8f140af08 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:34:58.844809 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1344/2646] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:34:58 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:35:03.963314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a111c-9ed4-4b0f-bab8-aa81a7ad6657 service swift] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:03.973122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a111c-9ed4-4b0f-bab8-aa81a7ad6657 service swift] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:03.976689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6033b8-a40a-4af2-94d4-ae92101286e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:03.977258 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6033b8-a40a-4af2-94d4-ae92101286e7 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:03.977539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6033b8-a40a-4af2-94d4-ae92101286e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:03.977809 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6033b8-a40a-4af2-94d4-ae92101286e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:03.979530 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ee6033b8-a40a-4af2-94d4-ae92101286e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:04.040449 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6033b8-a40a-4af2-94d4-ae92101286e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:04.041859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6033b8-a40a-4af2-94d4-ae92101286e7 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:04.051165 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1303/2647] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:35:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:35:10.971287 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40a992-cece-4c04-9cab-75c8f140af08 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:10.972915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1b40a992-cece-4c04-9cab-75c8f140af08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:10.988570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40a992-cece-4c04-9cab-75c8f140af08 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:10.993273 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:10.994145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:10.994433 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:10.994741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] PATH_INFO: `/v3/users/31c9651dc204465eb9038c903a08910f` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:10.995932 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c9651dc204465eb9038c903a08910f)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:10.997863 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:11.047098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c9651dc204465eb9038c903a08910f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.058769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c9651dc204465eb9038c903a08910f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.059453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c9651dc204465eb9038c903a08910f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.065976 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c9651dc204465eb9038c903a08910f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.066604 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c9651dc204465eb9038c903a08910f'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.078998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1345/2648] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:35:10 2021] DELETE /identity/v3/users/31c9651dc204465eb9038c903a08910f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:35:11.244985 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6033b8-a40a-4af2-94d4-ae92101286e7 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:11.255269 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6033b8-a40a-4af2-94d4-ae92101286e7 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:11.311801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:11.312654 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:11.312939 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:11.313221 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] PATH_INFO: `/v3/projects/cdf67756f57948e9a1bcaae4578b8fb6` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:11.314401 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf67756f57948e9a1bcaae4578b8fb6)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:11.316338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:11.361947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf67756f57948e9a1bcaae4578b8fb6', 'request_id': 'req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.368125 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf67756f57948e9a1bcaae4578b8fb6', 'request_id': 'req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.373586 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf67756f57948e9a1bcaae4578b8fb6', 'request_id': 'req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.386434 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] The token cache is being invalidate because project cdf67756f57948e9a1bcaae4578b8fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:35:11.386770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.387402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.389470 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1304/2649] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:35:11 2021] DELETE /identity/v3/projects/cdf67756f57948e9a1bcaae4578b8fb6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:35:11.393539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:11.395092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:11.408811 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d41f3-a15b-4612-8d08-730b7dd1a8d2 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:11.462874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:11.463749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:11.464033 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:11.464311 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] PATH_INFO: `/v3/users/f01410474c294d1397821af0d866f560` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:11.465516 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01410474c294d1397821af0d866f560)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:11.468044 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:11.514778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01410474c294d1397821af0d866f560'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.525732 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01410474c294d1397821af0d866f560'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.526379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01410474c294d1397821af0d866f560'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.533575 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01410474c294d1397821af0d866f560'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.534194 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-79c92d0f-cb59-4729-a598-5216b3327f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01410474c294d1397821af0d866f560'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.546188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1346/2650] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:35:11 2021] DELETE /identity/v3/users/f01410474c294d1397821af0d866f560 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:35:11.711733 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:11.713154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:11.725509 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a8d1-d6a7-4d8b-a2ea-c5a23c9f56c2 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:11.779031 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:11.779915 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:11.780198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:11.780471 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] PATH_INFO: `/v3/projects/86c670a5acab4a2cbcfbb3296c0e4488` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:11.781624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c670a5acab4a2cbcfbb3296c0e4488)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:11.783543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:11.825645 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c670a5acab4a2cbcfbb3296c0e4488', 'request_id': 'req-98a2ed02-ce22-4e18-abe3-795188f1dd3e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.831973 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c670a5acab4a2cbcfbb3296c0e4488', 'request_id': 'req-98a2ed02-ce22-4e18-abe3-795188f1dd3e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.837296 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c670a5acab4a2cbcfbb3296c0e4488', 'request_id': 'req-98a2ed02-ce22-4e18-abe3-795188f1dd3e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.849870 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] The token cache is being invalidate because project 86c670a5acab4a2cbcfbb3296c0e4488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:35:11.850158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.851087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:35:11.852293 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1305/2651] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:35:11 2021] DELETE /identity/v3/projects/86c670a5acab4a2cbcfbb3296c0e4488 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:35:12.281653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9ebe5-cb49-43c3-be72-d87f9edff26c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:12.282149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9ebe5-cb49-43c3-be72-d87f9edff26c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:12.282263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9ebe5-cb49-43c3-be72-d87f9edff26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:12.301305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b0b9ebe5-cb49-43c3-be72-d87f9edff26c None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:35:12.302641 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b0b9ebe5-cb49-43c3-be72-d87f9edff26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:12.358098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1347/2652] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:35:12 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:35:12.371099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:12.372496 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:12.441364 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2ed02-ce22-4e18-abe3-795188f1dd3e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:12.446997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b63a1-20a8-4782-8251-9d89ef309a88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:12.447657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b63a1-20a8-4782-8251-9d89ef309a88 service swift] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:12.447941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b63a1-20a8-4782-8251-9d89ef309a88 service swift] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:12.448216 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b63a1-20a8-4782-8251-9d89ef309a88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:12.456628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b63a1-20a8-4782-8251-9d89ef309a88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:12.458206 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b63a1-20a8-4782-8251-9d89ef309a88 service swift] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:12.467440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1306/2653] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:35:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:35:14.396890 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9ebe5-cb49-43c3-be72-d87f9edff26c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:14.398318 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b0b9ebe5-cb49-43c3-be72-d87f9edff26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:14.467470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9ebe5-cb49-43c3-be72-d87f9edff26c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:14.471204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd7b54-5007-46c4-a72c-5fc765e86cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:14.471876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7b54-5007-46c4-a72c-5fc765e86cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:14.472145 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7b54-5007-46c4-a72c-5fc765e86cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:14.472423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7b54-5007-46c4-a72c-5fc765e86cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:14.474929 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-d4cd7b54-5007-46c4-a72c-5fc765e86cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:14.552838 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd7b54-5007-46c4-a72c-5fc765e86cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:14.554203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd7b54-5007-46c4-a72c-5fc765e86cb9 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:14.564869 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1348/2654] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:35:14 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:35:22.243847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b63a1-20a8-4782-8251-9d89ef309a88 service swift] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:22.248908 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-420b63a1-20a8-4782-8251-9d89ef309a88 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:22.322947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b63a1-20a8-4782-8251-9d89ef309a88 service swift] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:22.328739 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148154a2-5382-487f-a47d-1baebbc30f04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b49222a8e4474bbe14019418ec8aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:22.329629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148154a2-5382-487f-a47d-1baebbc30f04 service placement] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:22.330069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148154a2-5382-487f-a47d-1baebbc30f04 service placement] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:22.330517 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148154a2-5382-487f-a47d-1baebbc30f04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:22.332525 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-148154a2-5382-487f-a47d-1baebbc30f04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:22.344760 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148154a2-5382-487f-a47d-1baebbc30f04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:22.346320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148154a2-5382-487f-a47d-1baebbc30f04 service placement] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:22.356009 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1307/2655] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:35:22 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:35:23.545315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4fa6c-7e7b-44c9-bbbf-072bb661b0e9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:23.545849 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4fa6c-7e7b-44c9-bbbf-072bb661b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:23.545958 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4fa6c-7e7b-44c9-bbbf-072bb661b0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:23.563190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-08c4fa6c-7e7b-44c9-bbbf-072bb661b0e9 None None] MFA Rules not processed for user `2fba46fcf5a742d28b39d9fef9c91df5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:35:23.564392 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-08c4fa6c-7e7b-44c9-bbbf-072bb661b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:23.615977 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1349/2656] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:35:23 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:35:26.786701 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95719932-4a41-4fb7-bac7-8c5ef12ae967 None None] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:26.787903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95719932-4a41-4fb7-bac7-8c5ef12ae967 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:26.788350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95719932-4a41-4fb7-bac7-8c5ef12ae967 None None] PATH_INFO: `/` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:26.790392 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1308/2657] 10.222.0.23 () {54 vars in 921 bytes} [Wed Aug 25 01:35:26 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 01:35:26.796642 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905fce-9f9c-4f5e-b94c-bb72fc22b3d3 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:26.797149 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905fce-9f9c-4f5e-b94c-bb72fc22b3d3 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:26.797280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905fce-9f9c-4f5e-b94c-bb72fc22b3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:26.822444 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-90905fce-9f9c-4f5e-b94c-bb72fc22b3d3 None None] MFA Rules not processed for user `d061cf5060334e79ab4f22518d37116f`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:35:26.824108 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-90905fce-9f9c-4f5e-b94c-bb72fc22b3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:26.931623 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1350/2658] 10.222.0.23 () {58 vars in 1019 bytes} [Wed Aug 25 01:35:26 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:35:26.941087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95719932-4a41-4fb7-bac7-8c5ef12ae967 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:26.943233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-95719932-4a41-4fb7-bac7-8c5ef12ae967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:27.010116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95719932-4a41-4fb7-bac7-8c5ef12ae967 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:27.031594 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c78d44-c229-4a79-a739-5d25c7acf404 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0b9d35e26e64c959e075622321df3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:27.032260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c78d44-c229-4a79-a739-5d25c7acf404 service glance] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:27.032722 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c78d44-c229-4a79-a739-5d25c7acf404 service glance] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:27.033003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c78d44-c229-4a79-a739-5d25c7acf404 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:27.044957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c78d44-c229-4a79-a739-5d25c7acf404 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:27.046653 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c78d44-c229-4a79-a739-5d25c7acf404 service glance] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:27.058745 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1309/2659] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:35:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:35:29.045734 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad19a11-772b-45ea-aa23-112917e7c5f6 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:29.046210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad19a11-772b-45ea-aa23-112917e7c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:29.046305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad19a11-772b-45ea-aa23-112917e7c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:29.064105 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-0ad19a11-772b-45ea-aa23-112917e7c5f6 None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:35:29.065302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-0ad19a11-772b-45ea-aa23-112917e7c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:29.072315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1351/2660] 10.222.0.23 () {58 vars in 1010 bytes} [Wed Aug 25 01:35:29 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:35:29.085352 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c78d44-c229-4a79-a739-5d25c7acf404 service glance] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:29.096343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c78d44-c229-4a79-a739-5d25c7acf404 service glance] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:29.101567 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd059b-ebee-4533-b29c-bdc257eac340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:29.102209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd059b-ebee-4533-b29c-bdc257eac340 service swift] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:29.102518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd059b-ebee-4533-b29c-bdc257eac340 service swift] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:29.102833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd059b-ebee-4533-b29c-bdc257eac340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:29.111062 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd059b-ebee-4533-b29c-bdc257eac340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:29.112623 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd059b-ebee-4533-b29c-bdc257eac340 service swift] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:29.120515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1310/2661] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:35:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:35:49.759250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a42ae-e7f0-4ae8-b031-e4306d790e16 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:49.760058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a42ae-e7f0-4ae8-b031-e4306d790e16 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:49.760058 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a42ae-e7f0-4ae8-b031-e4306d790e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:49.777924 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-397a42ae-e7f0-4ae8-b031-e4306d790e16 None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:35:49.779156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-397a42ae-e7f0-4ae8-b031-e4306d790e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:35:49.786137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1352/2662] 10.222.0.23 () {58 vars in 968 bytes} [Wed Aug 25 01:35:49 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:35:49.812141 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd059b-ebee-4533-b29c-bdc257eac340 service swift] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:35:49.822620 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd059b-ebee-4533-b29c-bdc257eac340 service swift] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:35:49.828154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeef46-31fb-440c-b989-ee339da1a1f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:35:49.828805 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeef46-31fb-440c-b989-ee339da1a1f6 service swift] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:35:49.829115 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeef46-31fb-440c-b989-ee339da1a1f6 service swift] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:35:49.829396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeef46-31fb-440c-b989-ee339da1a1f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:35:49.846177 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aeef46-31fb-440c-b989-ee339da1a1f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:35:49.847806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aeef46-31fb-440c-b989-ee339da1a1f6 service swift] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:35:49.856130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1311/2663] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:35:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 01:36:24.149572 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a42ae-e7f0-4ae8-b031-e4306d790e16 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:24.151046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-397a42ae-e7f0-4ae8-b031-e4306d790e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:24.204141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a42ae-e7f0-4ae8-b031-e4306d790e16 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:24.207670 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f167786-609f-4d69-b3e3-924d87046df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:24.208305 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f167786-609f-4d69-b3e3-924d87046df4 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:24.208590 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f167786-609f-4d69-b3e3-924d87046df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:24.208868 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f167786-609f-4d69-b3e3-924d87046df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:24.210545 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4f167786-609f-4d69-b3e3-924d87046df4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:24.265885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f167786-609f-4d69-b3e3-924d87046df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:24.267347 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f167786-609f-4d69-b3e3-924d87046df4 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:24.275874 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1353/2664] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:36:24 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:36:31.245665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeef46-31fb-440c-b989-ee339da1a1f6 service swift] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:31.247714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-a0aeef46-31fb-440c-b989-ee339da1a1f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:31.260904 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeef46-31fb-440c-b989-ee339da1a1f6 service swift] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:31.264549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9796f-7f9e-410a-9d51-6a54c10589af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:31.265204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9796f-7f9e-410a-9d51-6a54c10589af service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:31.265489 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9796f-7f9e-410a-9d51-6a54c10589af service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:31.265767 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9796f-7f9e-410a-9d51-6a54c10589af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:31.267624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e4e9796f-7f9e-410a-9d51-6a54c10589af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:31.335154 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9796f-7f9e-410a-9d51-6a54c10589af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:31.336731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9796f-7f9e-410a-9d51-6a54c10589af service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:31.350991 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1312/2665] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:36:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:36:34.911230 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f167786-609f-4d69-b3e3-924d87046df4 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:34.912704 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4f167786-609f-4d69-b3e3-924d87046df4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:34.926002 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f167786-609f-4d69-b3e3-924d87046df4 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:34.930469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:34.931357 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:34.931632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:34.931915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] PATH_INFO: `/v3/users/a8a2c266dd464ce2a957aa7960049b9d` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:34.933081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a2c266dd464ce2a957aa7960049b9d)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:34.935539 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:34.981991 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a2c266dd464ce2a957aa7960049b9d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:34.993826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a2c266dd464ce2a957aa7960049b9d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:34.994503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a2c266dd464ce2a957aa7960049b9d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:35.001733 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a2c266dd464ce2a957aa7960049b9d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:35.002409 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-ced75936-1fd4-4b1b-a62c-47dc1b749317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a2c266dd464ce2a957aa7960049b9d'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:35.016316 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1354/2666] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:36:34 2021] DELETE /identity/v3/users/a8a2c266dd464ce2a957aa7960049b9d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:36:35.187858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9796f-7f9e-410a-9d51-6a54c10589af service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:35.198568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9796f-7f9e-410a-9d51-6a54c10589af service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:35.254867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:35.255631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.255912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.256306 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] PATH_INFO: `/v3/projects/0d3f6d9b58da4cf08feb13c48725af79` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.257490 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3f6d9b58da4cf08feb13c48725af79)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:35.259682 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:35.305478 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3f6d9b58da4cf08feb13c48725af79', 'request_id': 'req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:35.312198 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3f6d9b58da4cf08feb13c48725af79', 'request_id': 'req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:35.317558 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3f6d9b58da4cf08feb13c48725af79', 'request_id': 'req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:35.330301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] The token cache is being invalidate because project 0d3f6d9b58da4cf08feb13c48725af79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:36:35.330605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:35.331239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-fe39f9e2-44b7-4a1a-96a1-1ba4b3d8e552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:35.332752 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1313/2667] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:36:35 2021] DELETE /identity/v3/projects/0d3f6d9b58da4cf08feb13c48725af79 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:36:35.339399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9df16-1f8f-4d82-a0c1-0d3297c45e57 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.339723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9df16-1f8f-4d82-a0c1-0d3297c45e57 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.340086 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9df16-1f8f-4d82-a0c1-0d3297c45e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.358160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-fec9df16-1f8f-4d82-a0c1-0d3297c45e57 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:36:35.359405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fec9df16-1f8f-4d82-a0c1-0d3297c45e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:35.415175 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1355/2668] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:36:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:36:35.423005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242583d8-71f8-45f2-88a5-6c5adbad68cb None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.423326 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242583d8-71f8-45f2-88a5-6c5adbad68cb None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.423609 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242583d8-71f8-45f2-88a5-6c5adbad68cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.441732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-242583d8-71f8-45f2-88a5-6c5adbad68cb None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:36:35.442954 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-242583d8-71f8-45f2-88a5-6c5adbad68cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:35.450513 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1314/2669] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:36:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:36:35.454360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9df16-1f8f-4d82-a0c1-0d3297c45e57 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:35.463743 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9df16-1f8f-4d82-a0c1-0d3297c45e57 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:35.468265 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665129c-d4ab-4545-8b85-cc419c44dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:35.468912 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665129c-d4ab-4545-8b85-cc419c44dfdd admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.469227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665129c-d4ab-4545-8b85-cc419c44dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.469507 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665129c-d4ab-4545-8b85-cc419c44dfdd admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.470222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665129c-d4ab-4545-8b85-cc419c44dfdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:36:35.470529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665129c-d4ab-4545-8b85-cc419c44dfdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:35.472144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665129c-d4ab-4545-8b85-cc419c44dfdd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:35.483685 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1356/2670] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:36:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:36:35.487703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242583d8-71f8-45f2-88a5-6c5adbad68cb None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:35.496703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242583d8-71f8-45f2-88a5-6c5adbad68cb None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:35.501997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a9bd-83ae-4f0c-bb1b-07adc9749f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:35.502641 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a9bd-83ae-4f0c-bb1b-07adc9749f15 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.502957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a9bd-83ae-4f0c-bb1b-07adc9749f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.503236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a9bd-83ae-4f0c-bb1b-07adc9749f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.503929 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1a9bd-83ae-4f0c-bb1b-07adc9749f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:35.505880 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1a9bd-83ae-4f0c-bb1b-07adc9749f15 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:35.531014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1315/2671] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:36:35 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:36:35.535047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665129c-d4ab-4545-8b85-cc419c44dfdd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:35.545184 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665129c-d4ab-4545-8b85-cc419c44dfdd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:35.599349 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d228a85-20d1-4f0b-8457-deaf69f5e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:35.600012 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d228a85-20d1-4f0b-8457-deaf69f5e770 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.600300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d228a85-20d1-4f0b-8457-deaf69f5e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.600581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d228a85-20d1-4f0b-8457-deaf69f5e770 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.601256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d228a85-20d1-4f0b-8457-deaf69f5e770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:35.603193 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d228a85-20d1-4f0b-8457-deaf69f5e770 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:35.621819 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1357/2672] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:36:35 2021] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:36:35.625867 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a9bd-83ae-4f0c-bb1b-07adc9749f15 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:35.636533 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a9bd-83ae-4f0c-bb1b-07adc9749f15 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:35.641194 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac164cef-5525-4a59-9886-5b9926374c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:35.641848 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164cef-5525-4a59-9886-5b9926374c27 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.642137 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164cef-5525-4a59-9886-5b9926374c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.642418 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164cef-5525-4a59-9886-5b9926374c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.643174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac164cef-5525-4a59-9886-5b9926374c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:35.644754 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac164cef-5525-4a59-9886-5b9926374c27 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:35.655528 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1316/2673] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:36:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:36:35.659394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d228a85-20d1-4f0b-8457-deaf69f5e770 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:35.671546 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d228a85-20d1-4f0b-8457-deaf69f5e770 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:35.676665 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018d244-9989-4131-9a38-7d6d870fcce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:35.677325 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018d244-9989-4131-9a38-7d6d870fcce6 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.677634 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018d244-9989-4131-9a38-7d6d870fcce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.677917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018d244-9989-4131-9a38-7d6d870fcce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.678638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018d244-9989-4131-9a38-7d6d870fcce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:35.680270 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018d244-9989-4131-9a38-7d6d870fcce6 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:35.689881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1358/2674] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:36:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:36:35.693868 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac164cef-5525-4a59-9886-5b9926374c27 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:35.703387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac164cef-5525-4a59-9886-5b9926374c27 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:35.707850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b169ce7-0586-41fa-ac50-04bc2924de88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:35.708706 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169ce7-0586-41fa-ac50-04bc2924de88 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.708987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169ce7-0586-41fa-ac50-04bc2924de88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.709263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169ce7-0586-41fa-ac50-04bc2924de88 admin admin] PATH_INFO: `/v3/projects/36f405efc49746539f544934039a5f58/users/68ac9a0b7cf1483d815ec9e4080ce386/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.723812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b169ce7-0586-41fa-ac50-04bc2924de88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f405efc49746539f544934039a5f58, user_id=68ac9a0b7cf1483d815ec9e4080ce386, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:35.726643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b169ce7-0586-41fa-ac50-04bc2924de88 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:35.744990 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1317/2675] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:36:35 2021] PUT /identity/v3/projects/36f405efc49746539f544934039a5f58/users/68ac9a0b7cf1483d815ec9e4080ce386/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:36:35.756653 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63301d8-7e73-4580-abf2-d3382b441f1d None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.756992 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63301d8-7e73-4580-abf2-d3382b441f1d None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.757370 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63301d8-7e73-4580-abf2-d3382b441f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.784456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-b63301d8-7e73-4580-abf2-d3382b441f1d None None] MFA Rules not processed for user `68ac9a0b7cf1483d815ec9e4080ce386`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:36:35.785678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b63301d8-7e73-4580-abf2-d3382b441f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:35.848485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1359/2676] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:36:35 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:36:35.860642 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b169ce7-0586-41fa-ac50-04bc2924de88 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:35.862757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6b169ce7-0586-41fa-ac50-04bc2924de88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:35.932859 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b169ce7-0586-41fa-ac50-04bc2924de88 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:35.939317 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce7070-1ce5-45f9-a214-77dfa3f1cc06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:35.939958 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7070-1ce5-45f9-a214-77dfa3f1cc06 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:35.940242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7070-1ce5-45f9-a214-77dfa3f1cc06 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:35.940519 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7070-1ce5-45f9-a214-77dfa3f1cc06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:35.948231 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce7070-1ce5-45f9-a214-77dfa3f1cc06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:35.949819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce7070-1ce5-45f9-a214-77dfa3f1cc06 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:35.959444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1318/2677] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:36:35 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:36:37.519557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fefbc4-864b-4adf-aa06-4f4153e833bd None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:37.520060 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fefbc4-864b-4adf-aa06-4f4153e833bd None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:37.520295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fefbc4-864b-4adf-aa06-4f4153e833bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:37.538847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-49fefbc4-864b-4adf-aa06-4f4153e833bd None None] MFA Rules not processed for user `bf5aac81feed4af7b9969937afe5a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:36:37.540188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-49fefbc4-864b-4adf-aa06-4f4153e833bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:37.603150 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1360/2678] 10.222.0.23 () {58 vars in 968 bytes} [Wed Aug 25 01:36:37 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:36:37.616487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce7070-1ce5-45f9-a214-77dfa3f1cc06 service nova] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:37.617901 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f7ce7070-1ce5-45f9-a214-77dfa3f1cc06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:37.686921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce7070-1ce5-45f9-a214-77dfa3f1cc06 service nova] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:37.691998 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570051a-0228-4a4b-89a1-1962feb23085 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c258c3fbf470fac4af9966ac5f0c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:37.692696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570051a-0228-4a4b-89a1-1962feb23085 service swift] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:37.692975 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570051a-0228-4a4b-89a1-1962feb23085 service swift] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:37.693250 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570051a-0228-4a4b-89a1-1962feb23085 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:37.701359 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570051a-0228-4a4b-89a1-1962feb23085 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:37.702971 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570051a-0228-4a4b-89a1-1962feb23085 service swift] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:37.710735 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1319/2679] 10.222.0.23 () {60 vars in 1385 bytes} [Wed Aug 25 01:36:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 01:36:43.228223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fefbc4-864b-4adf-aa06-4f4153e833bd None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:43.292960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fefbc4-864b-4adf-aa06-4f4153e833bd None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:43.300102 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:43.301006 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:43.301288 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:43.301566 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] PATH_INFO: `/v3/users/68ac9a0b7cf1483d815ec9e4080ce386` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:43.302817 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ac9a0b7cf1483d815ec9e4080ce386)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:43.304762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:43.361824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ac9a0b7cf1483d815ec9e4080ce386'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:43.374330 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ac9a0b7cf1483d815ec9e4080ce386'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:43.375050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ac9a0b7cf1483d815ec9e4080ce386'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:43.381801 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ac9a0b7cf1483d815ec9e4080ce386'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:43.382458 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ac9a0b7cf1483d815ec9e4080ce386'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:43.395749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1361/2680] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:36:43 2021] DELETE /identity/v3/users/68ac9a0b7cf1483d815ec9e4080ce386 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:36:43.400419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd836-0bb2-4c33-a9ea-fafa7d5d3ebd None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:43.400928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd836-0bb2-4c33-a9ea-fafa7d5d3ebd None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:43.401042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd836-0bb2-4c33-a9ea-fafa7d5d3ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:43.417514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-02bcd836-0bb2-4c33-a9ea-fafa7d5d3ebd None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:36:43.418732 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-02bcd836-0bb2-4c33-a9ea-fafa7d5d3ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:43.474927 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1320/2681] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:36:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:36:43.485564 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:43.487144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:43.545697 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd17725-8b3c-4499-9472-995d9316f3e1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:43.549399 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2f894-cfe6-4648-9a96-6c1d25ae49e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:43.550099 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2f894-cfe6-4648-9a96-6c1d25ae49e3 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:43.550385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2f894-cfe6-4648-9a96-6c1d25ae49e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:43.550726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2f894-cfe6-4648-9a96-6c1d25ae49e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:43.559903 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2f894-cfe6-4648-9a96-6c1d25ae49e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:43.561959 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2f894-cfe6-4648-9a96-6c1d25ae49e3 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:43.571551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1362/2682] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:36:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:36:44.021395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd836-0bb2-4c33-a9ea-fafa7d5d3ebd None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.023042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-02bcd836-0bb2-4c33-a9ea-fafa7d5d3ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:44.039445 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd836-0bb2-4c33-a9ea-fafa7d5d3ebd None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.046260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.048284 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.048727 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.049169 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] PATH_INFO: `/v3/projects/36f405efc49746539f544934039a5f58` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.054015 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f405efc49746539f544934039a5f58)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.056365 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.120059 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f405efc49746539f544934039a5f58', 'request_id': 'req-ba5d7360-4f78-4cb7-bd01-73275d96a092'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.128331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f405efc49746539f544934039a5f58', 'request_id': 'req-ba5d7360-4f78-4cb7-bd01-73275d96a092'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.136274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f405efc49746539f544934039a5f58', 'request_id': 'req-ba5d7360-4f78-4cb7-bd01-73275d96a092'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.154490 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] The token cache is being invalidate because project 36f405efc49746539f544934039a5f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:36:44.154933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.155629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ba5d7360-4f78-4cb7-bd01-73275d96a092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.157255 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1321/2683] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:36:44 2021] DELETE /identity/v3/projects/36f405efc49746539f544934039a5f58 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:36:44.163161 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015c34-caf3-4f36-8d7f-781a0c969721 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.163446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015c34-caf3-4f36-8d7f-781a0c969721 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.163939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015c34-caf3-4f36-8d7f-781a0c969721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.184582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-69015c34-caf3-4f36-8d7f-781a0c969721 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:36:44.186167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-69015c34-caf3-4f36-8d7f-781a0c969721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:44.252452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1363/2684] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:36:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:36:44.260325 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955d94b-64e9-4050-9f32-006b845e7ba5 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.260611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955d94b-64e9-4050-9f32-006b845e7ba5 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.261307 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955d94b-64e9-4050-9f32-006b845e7ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.288970 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-4955d94b-64e9-4050-9f32-006b845e7ba5 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:36:44.290314 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-4955d94b-64e9-4050-9f32-006b845e7ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:44.299846 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1322/2685] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:36:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:36:44.304170 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69015c34-caf3-4f36-8d7f-781a0c969721 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.320156 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69015c34-caf3-4f36-8d7f-781a0c969721 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.325245 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654100ef-8e61-49f7-a310-58a7948b1321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.326441 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654100ef-8e61-49f7-a310-58a7948b1321 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.326774 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654100ef-8e61-49f7-a310-58a7948b1321 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.327054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654100ef-8e61-49f7-a310-58a7948b1321 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.327774 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654100ef-8e61-49f7-a310-58a7948b1321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:36:44.328075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654100ef-8e61-49f7-a310-58a7948b1321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.329726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654100ef-8e61-49f7-a310-58a7948b1321 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.351324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1364/2686] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:36:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:36:44.352448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955d94b-64e9-4050-9f32-006b845e7ba5 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.362454 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955d94b-64e9-4050-9f32-006b845e7ba5 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.367447 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a0efc-6c5e-46ea-b6f5-fe201d745903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.368091 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a0efc-6c5e-46ea-b6f5-fe201d745903 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.368371 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a0efc-6c5e-46ea-b6f5-fe201d745903 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.368643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a0efc-6c5e-46ea-b6f5-fe201d745903 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.369321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a0efc-6c5e-46ea-b6f5-fe201d745903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.371514 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a0efc-6c5e-46ea-b6f5-fe201d745903 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.397395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1323/2687] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:36:44 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:36:44.401875 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654100ef-8e61-49f7-a310-58a7948b1321 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.414830 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654100ef-8e61-49f7-a310-58a7948b1321 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.471204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364cb62-2821-4ab5-b5c4-e43ce7b6e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.472110 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364cb62-2821-4ab5-b5c4-e43ce7b6e984 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.472381 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364cb62-2821-4ab5-b5c4-e43ce7b6e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.472673 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364cb62-2821-4ab5-b5c4-e43ce7b6e984 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.473335 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364cb62-2821-4ab5-b5c4-e43ce7b6e984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.475282 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364cb62-2821-4ab5-b5c4-e43ce7b6e984 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.477045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a0efc-6c5e-46ea-b6f5-fe201d745903 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.489302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8b0a0efc-6c5e-46ea-b6f5-fe201d745903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:44.498566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a0efc-6c5e-46ea-b6f5-fe201d745903 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.503046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1365/2688] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:36:44 2021] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:36:44.503229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.504333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.504629 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.504906 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] PATH_INFO: `/v3/users/0b39db8c6d1a4a7591acabe30d1cc60b` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.506123 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b39db8c6d1a4a7591acabe30d1cc60b)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.507068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364cb62-2821-4ab5-b5c4-e43ce7b6e984 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.508063 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.517828 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364cb62-2821-4ab5-b5c4-e43ce7b6e984 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.522443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93e76b-f544-41a1-9b10-31e1d4b8ddc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.523199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93e76b-f544-41a1-9b10-31e1d4b8ddc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.523478 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93e76b-f544-41a1-9b10-31e1d4b8ddc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.523751 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93e76b-f544-41a1-9b10-31e1d4b8ddc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.524490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93e76b-f544-41a1-9b10-31e1d4b8ddc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.526068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93e76b-f544-41a1-9b10-31e1d4b8ddc1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.538713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1366/2689] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:36:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:36:44.541474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93e76b-f544-41a1-9b10-31e1d4b8ddc1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.553285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93e76b-f544-41a1-9b10-31e1d4b8ddc1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.557508 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b39db8c6d1a4a7591acabe30d1cc60b'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.558718 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bccf83-ece8-4f03-ace0-791583032d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.559423 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bccf83-ece8-4f03-ace0-791583032d96 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.559707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bccf83-ece8-4f03-ace0-791583032d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.560507 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bccf83-ece8-4f03-ace0-791583032d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.561216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bccf83-ece8-4f03-ace0-791583032d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.562822 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bccf83-ece8-4f03-ace0-791583032d96 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.565921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b39db8c6d1a4a7591acabe30d1cc60b'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.566827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b39db8c6d1a4a7591acabe30d1cc60b'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.567342 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b39db8c6d1a4a7591acabe30d1cc60b'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.577160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1367/2690] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:36:44 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:36:44.577330 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-64b18ee8-5c32-44f3-b47e-a573539b61d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b39db8c6d1a4a7591acabe30d1cc60b'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.578244 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bccf83-ece8-4f03-ace0-791583032d96 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.580153 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-82bccf83-ece8-4f03-ace0-791583032d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:44.592277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1324/2691] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:36:44 2021] DELETE /identity/v3/users/0b39db8c6d1a4a7591acabe30d1cc60b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:36:44.592498 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bccf83-ece8-4f03-ace0-791583032d96 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.647182 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044fdc3-460d-494f-b042-df9484b61c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.648076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044fdc3-460d-494f-b042-df9484b61c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.648355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044fdc3-460d-494f-b042-df9484b61c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.648625 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044fdc3-460d-494f-b042-df9484b61c2b admin admin] PATH_INFO: `/v3/projects/1d5e0ee21c68479a84f7d5ae09459729/users/4bc0e5b8171143c397928d62be3d24fc/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.662327 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044fdc3-460d-494f-b042-df9484b61c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5e0ee21c68479a84f7d5ae09459729, user_id=4bc0e5b8171143c397928d62be3d24fc, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.664993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044fdc3-460d-494f-b042-df9484b61c2b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.677943 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1368/2692] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:36:44 2021] PUT /identity/v3/projects/1d5e0ee21c68479a84f7d5ae09459729/users/4bc0e5b8171143c397928d62be3d24fc/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:36:44.688858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edfbe8-9986-4103-8fca-cb4b6d5e47a2 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.689146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edfbe8-9986-4103-8fca-cb4b6d5e47a2 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.689425 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edfbe8-9986-4103-8fca-cb4b6d5e47a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.716646 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-71edfbe8-9986-4103-8fca-cb4b6d5e47a2 None None] MFA Rules not processed for user `4bc0e5b8171143c397928d62be3d24fc`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:36:44.717793 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-71edfbe8-9986-4103-8fca-cb4b6d5e47a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:44.762449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044fdc3-460d-494f-b042-df9484b61c2b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.764949 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b044fdc3-460d-494f-b042-df9484b61c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:44.790790 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1325/2693] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:36:44 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:36:44.791666 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edfbe8-9986-4103-8fca-cb4b6d5e47a2 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.828256 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044fdc3-460d-494f-b042-df9484b61c2b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.832940 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.833795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.834080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.834355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] PATH_INFO: `/v3/projects/bd502484c4f842cab183438793976e99` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.835551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd502484c4f842cab183438793976e99)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.837460 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.850606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edfbe8-9986-4103-8fca-cb4b6d5e47a2 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.855173 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9a533-184a-435f-a326-8001a5ee56e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.855819 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9a533-184a-435f-a326-8001a5ee56e1 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.856103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9a533-184a-435f-a326-8001a5ee56e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.856375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9a533-184a-435f-a326-8001a5ee56e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.857082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9a533-184a-435f-a326-8001a5ee56e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.858988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9a533-184a-435f-a326-8001a5ee56e1 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.884610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd502484c4f842cab183438793976e99', 'request_id': 'req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.885900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1326/2694] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:36:44 2021] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:36:44.890321 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9a533-184a-435f-a326-8001a5ee56e1 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.891680 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd502484c4f842cab183438793976e99', 'request_id': 'req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.897021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd502484c4f842cab183438793976e99', 'request_id': 'req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.910054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] The token cache is being invalidate because project bd502484c4f842cab183438793976e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:36:44.910778 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.912269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:44.913899 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1369/2695] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:36:44 2021] DELETE /identity/v3/projects/bd502484c4f842cab183438793976e99 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:36:44.917767 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.919121 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:44.952134 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9a533-184a-435f-a326-8001a5ee56e1 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.957042 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb5f63-b04e-462f-aaf6-cd26560065cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.957708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb5f63-b04e-462f-aaf6-cd26560065cc admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.957996 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb5f63-b04e-462f-aaf6-cd26560065cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.958274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb5f63-b04e-462f-aaf6-cd26560065cc admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.959104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb5f63-b04e-462f-aaf6-cd26560065cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.961012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb5f63-b04e-462f-aaf6-cd26560065cc admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:44.983502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447c5d7-b8c4-4d37-b868-e2f0922fcbe3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:44.984841 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1327/2696] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:36:44 2021] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:36:44.988502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:44.989214 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb5f63-b04e-462f-aaf6-cd26560065cc admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:44.989509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:44.989797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:44.990081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] PATH_INFO: `/v3/users/078edf1865c34157bab4f45a7beb24d9` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:44.991138 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-94bb5f63-b04e-462f-aaf6-cd26560065cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:44.991343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=078edf1865c34157bab4f45a7beb24d9)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:44.993220 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:45.004297 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb5f63-b04e-462f-aaf6-cd26560065cc admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:45.009535 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f3f7c-db49-4e70-981a-2896240fe471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:45.010195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f3f7c-db49-4e70-981a-2896240fe471 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:45.010532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f3f7c-db49-4e70-981a-2896240fe471 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:45.010850 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f3f7c-db49-4e70-981a-2896240fe471 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:45.011572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f3f7c-db49-4e70-981a-2896240fe471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:45.013195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f3f7c-db49-4e70-981a-2896240fe471 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:45.024181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1328/2697] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:36:44 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:36:45.028215 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f3f7c-db49-4e70-981a-2896240fe471 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:45.037839 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f3f7c-db49-4e70-981a-2896240fe471 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:45.042420 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39941c-4090-4ebf-bc1e-ac9a76003596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:45.043312 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39941c-4090-4ebf-bc1e-ac9a76003596 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:45.043592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39941c-4090-4ebf-bc1e-ac9a76003596 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:45.043865 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39941c-4090-4ebf-bc1e-ac9a76003596 admin admin] PATH_INFO: `/v3/projects/b087fff5bfb34ce98b97165d58b7b09b/users/9229085de7ed48cb85de4ae2991b9181/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:45.045014 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078edf1865c34157bab4f45a7beb24d9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:45.059066 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39941c-4090-4ebf-bc1e-ac9a76003596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b087fff5bfb34ce98b97165d58b7b09b, user_id=9229085de7ed48cb85de4ae2991b9181, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:45.062347 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39941c-4090-4ebf-bc1e-ac9a76003596 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:45.062647 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078edf1865c34157bab4f45a7beb24d9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:45.063586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078edf1865c34157bab4f45a7beb24d9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:45.071989 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078edf1865c34157bab4f45a7beb24d9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:45.073707 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078edf1865c34157bab4f45a7beb24d9'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:45.076807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1329/2698] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:36:45 2021] PUT /identity/v3/projects/b087fff5bfb34ce98b97165d58b7b09b/users/9229085de7ed48cb85de4ae2991b9181/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:36:45.079816 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39941c-4090-4ebf-bc1e-ac9a76003596 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:45.082159 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ff39941c-4090-4ebf-bc1e-ac9a76003596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:45.090972 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1370/2699] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:36:44 2021] DELETE /identity/v3/users/078edf1865c34157bab4f45a7beb24d9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:36:45.147658 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39941c-4090-4ebf-bc1e-ac9a76003596 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:45.201455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27146e-70ba-40e7-ba9a-096edd421976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:45.202116 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27146e-70ba-40e7-ba9a-096edd421976 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:45.202395 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27146e-70ba-40e7-ba9a-096edd421976 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:45.202668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27146e-70ba-40e7-ba9a-096edd421976 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:45.203402 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27146e-70ba-40e7-ba9a-096edd421976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:45.204976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27146e-70ba-40e7-ba9a-096edd421976 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:45.214555 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1330/2700] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:36:45 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:36:45.218825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:45.228567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a37c14-b3dc-4c14-b37b-2e69e4cc7b3b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:45.233784 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a5735-b889-433c-a43f-bcbfff9c1c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:45.234701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a5735-b889-433c-a43f-bcbfff9c1c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:45.234990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a5735-b889-433c-a43f-bcbfff9c1c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:45.235266 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a5735-b889-433c-a43f-bcbfff9c1c28 admin admin] PATH_INFO: `/v3/projects/b087fff5bfb34ce98b97165d58b7b09b/users/9229085de7ed48cb85de4ae2991b9181/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:45.237610 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a5735-b889-433c-a43f-bcbfff9c1c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b087fff5bfb34ce98b97165d58b7b09b, user_id=9229085de7ed48cb85de4ae2991b9181, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:45.240307 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a5735-b889-433c-a43f-bcbfff9c1c28 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:45.252635 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1371/2701] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:36:45 2021] PUT /identity/v3/projects/b087fff5bfb34ce98b97165d58b7b09b/users/9229085de7ed48cb85de4ae2991b9181/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:36:45.262573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27146e-70ba-40e7-ba9a-096edd421976 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:45.264543 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb275-a793-479c-be43-c9f9417b81c8 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:45.264749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3b27146e-70ba-40e7-ba9a-096edd421976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:45.265049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb275-a793-479c-be43-c9f9417b81c8 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:45.265464 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb275-a793-479c-be43-c9f9417b81c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:45.283103 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27146e-70ba-40e7-ba9a-096edd421976 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:45.295993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-cbecb275-a793-479c-be43-c9f9417b81c8 None None] MFA Rules not processed for user `9229085de7ed48cb85de4ae2991b9181`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:36:45.297238 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cbecb275-a793-479c-be43-c9f9417b81c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:45.338783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:45.339638 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:45.339927 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:45.340209 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] PATH_INFO: `/v3/projects/4984e0fae1a848f8ae135a533cb4eba0` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:45.341912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4984e0fae1a848f8ae135a533cb4eba0)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:45.343849 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:45.366258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1372/2702] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:36:45 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:36:45.376825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecb275-a793-479c-be43-c9f9417b81c8 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:45.378183 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cbecb275-a793-479c-be43-c9f9417b81c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:45.392236 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4984e0fae1a848f8ae135a533cb4eba0', 'request_id': 'req-40d12644-e000-4fcd-aaff-36f8b156bf0e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:45.398263 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4984e0fae1a848f8ae135a533cb4eba0', 'request_id': 'req-40d12644-e000-4fcd-aaff-36f8b156bf0e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:45.404226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4984e0fae1a848f8ae135a533cb4eba0', 'request_id': 'req-40d12644-e000-4fcd-aaff-36f8b156bf0e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:45.417549 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] The token cache is being invalidate because project 4984e0fae1a848f8ae135a533cb4eba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:36:45.417931 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:45.418567 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:36:45.420784 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1331/2703] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:36:45 2021] DELETE /identity/v3/projects/4984e0fae1a848f8ae135a533cb4eba0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:36:45.439231 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecb275-a793-479c-be43-c9f9417b81c8 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:45.497240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4b79f-fad3-483e-91d3-3dc71288878e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:45.497810 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4b79f-fad3-483e-91d3-3dc71288878e service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:45.498095 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4b79f-fad3-483e-91d3-3dc71288878e service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:45.498369 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4b79f-fad3-483e-91d3-3dc71288878e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:45.500331 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b7d4b79f-fad3-483e-91d3-3dc71288878e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:45.566586 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4b79f-fad3-483e-91d3-3dc71288878e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:45.568079 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4b79f-fad3-483e-91d3-3dc71288878e service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:45.578824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1373/2704] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:36:45 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:36:45.650147 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:36:45.651717 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:45.664793 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d12644-e000-4fcd-aaff-36f8b156bf0e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:36:45.668983 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e93ef0-9315-4111-a09d-9f56877dd5a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:36:45.670264 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e93ef0-9315-4111-a09d-9f56877dd5a7 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:36:45.670548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e93ef0-9315-4111-a09d-9f56877dd5a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:36:45.670862 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e93ef0-9315-4111-a09d-9f56877dd5a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:36:45.672571 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-73e93ef0-9315-4111-a09d-9f56877dd5a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:36:45.728654 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e93ef0-9315-4111-a09d-9f56877dd5a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:36:45.730082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e93ef0-9315-4111-a09d-9f56877dd5a7 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:36:45.738725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1332/2705] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:36:45 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:23.421025 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4b79f-fad3-483e-91d3-3dc71288878e service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:23.422432 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-b7d4b79f-fad3-483e-91d3-3dc71288878e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:23.483301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4b79f-fad3-483e-91d3-3dc71288878e service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:23.487840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:23.488761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:23.488980 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:23.489272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] PATH_INFO: `/v3/users/4bc0e5b8171143c397928d62be3d24fc` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:23.490523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc0e5b8171143c397928d62be3d24fc)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:23.492650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:23.537071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc0e5b8171143c397928d62be3d24fc'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:23.548488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc0e5b8171143c397928d62be3d24fc'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:23.549134 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc0e5b8171143c397928d62be3d24fc'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:23.555547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc0e5b8171143c397928d62be3d24fc'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:23.556162 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc0e5b8171143c397928d62be3d24fc'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:23.568914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1374/2706] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:37:23 2021] DELETE /identity/v3/users/4bc0e5b8171143c397928d62be3d24fc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:23.573675 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1b596-f8fc-4048-9476-21e5925d025c None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:23.574161 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1b596-f8fc-4048-9476-21e5925d025c None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:23.574271 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1b596-f8fc-4048-9476-21e5925d025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:23.590544 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-26b1b596-f8fc-4048-9476-21e5925d025c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:23.591782 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-26b1b596-f8fc-4048-9476-21e5925d025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:23.646410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1333/2707] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:37:23.656022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:23.657397 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:23.711536 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189f22b-6c92-45d3-aef1-5f0798017490 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:23.715164 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d872b3-735e-4356-b902-a67c741a446e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:23.715799 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d872b3-735e-4356-b902-a67c741a446e service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:23.716103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d872b3-735e-4356-b902-a67c741a446e service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:23.716378 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d872b3-735e-4356-b902-a67c741a446e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:23.725729 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d872b3-735e-4356-b902-a67c741a446e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:23.727186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d872b3-735e-4356-b902-a67c741a446e service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:23.736820 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1375/2708] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:24.009189 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1b596-f8fc-4048-9476-21e5925d025c None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:24.010599 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-26b1b596-f8fc-4048-9476-21e5925d025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:24.024242 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1b596-f8fc-4048-9476-21e5925d025c None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:24.030122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:24.031012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:24.031291 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:24.031569 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] PATH_INFO: `/v3/projects/1d5e0ee21c68479a84f7d5ae09459729` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:24.032726 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5e0ee21c68479a84f7d5ae09459729)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:24.034604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:24.077979 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5e0ee21c68479a84f7d5ae09459729', 'request_id': 'req-ee377aad-03f5-45d0-aea4-56fc66114564'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.083912 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5e0ee21c68479a84f7d5ae09459729', 'request_id': 'req-ee377aad-03f5-45d0-aea4-56fc66114564'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.089498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5e0ee21c68479a84f7d5ae09459729', 'request_id': 'req-ee377aad-03f5-45d0-aea4-56fc66114564'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.101501 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] The token cache is being invalidate because project 1d5e0ee21c68479a84f7d5ae09459729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:37:24.101796 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.102419 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.103942 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1334/2709] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:37:24 2021] DELETE /identity/v3/projects/1d5e0ee21c68479a84f7d5ae09459729 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:24.108574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d872b3-735e-4356-b902-a67c741a446e service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:24.117893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d872b3-735e-4356-b902-a67c741a446e service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:24.171126 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:24.171973 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:24.172255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:24.172529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] PATH_INFO: `/v3/users/9229085de7ed48cb85de4ae2991b9181` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:24.173675 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9229085de7ed48cb85de4ae2991b9181)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:24.175600 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:24.217530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9229085de7ed48cb85de4ae2991b9181'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.228954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9229085de7ed48cb85de4ae2991b9181'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.229593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9229085de7ed48cb85de4ae2991b9181'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.236730 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9229085de7ed48cb85de4ae2991b9181'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.237355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c80cd258-752b-4553-b704-b2c7c0d8845f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9229085de7ed48cb85de4ae2991b9181'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.249098 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1376/2710] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:37:24 2021] DELETE /identity/v3/users/9229085de7ed48cb85de4ae2991b9181 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:24.523512 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:24.524944 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:24.538175 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee377aad-03f5-45d0-aea4-56fc66114564 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:24.591054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:24.592524 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:24.592806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:24.593104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] PATH_INFO: `/v3/projects/b087fff5bfb34ce98b97165d58b7b09b` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:24.594254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b087fff5bfb34ce98b97165d58b7b09b)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:24.596149 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:24.639343 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b087fff5bfb34ce98b97165d58b7b09b', 'request_id': 'req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.645124 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b087fff5bfb34ce98b97165d58b7b09b', 'request_id': 'req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.650487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b087fff5bfb34ce98b97165d58b7b09b', 'request_id': 'req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.662708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] The token cache is being invalidate because project b087fff5bfb34ce98b97165d58b7b09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:37:24.663003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.663611 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-4fbbddab-eab1-48fe-a28d-f57cbe2400e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:24.665074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1335/2711] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:37:24 2021] DELETE /identity/v3/projects/b087fff5bfb34ce98b97165d58b7b09b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:24.671340 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baef0c-5aa3-445d-a399-b52cf6560529 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:24.671835 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baef0c-5aa3-445d-a399-b52cf6560529 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:24.672412 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baef0c-5aa3-445d-a399-b52cf6560529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:24.689923 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-42baef0c-5aa3-445d-a399-b52cf6560529 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:24.691160 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-42baef0c-5aa3-445d-a399-b52cf6560529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:24.746036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1377/2712] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:24.753856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c923ccf-e75c-4576-8a53-cfa71efe06dc None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:24.754144 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c923ccf-e75c-4576-8a53-cfa71efe06dc None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:24.754422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c923ccf-e75c-4576-8a53-cfa71efe06dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:24.772749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-3c923ccf-e75c-4576-8a53-cfa71efe06dc None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:24.773872 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3c923ccf-e75c-4576-8a53-cfa71efe06dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:24.781440 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1336/2713] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:24.785476 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baef0c-5aa3-445d-a399-b52cf6560529 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:24.795047 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baef0c-5aa3-445d-a399-b52cf6560529 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:24.799528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e16e5-87da-44b3-aacc-8f5aea0c9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:24.800167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e16e5-87da-44b3-aacc-8f5aea0c9a4a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:24.800449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e16e5-87da-44b3-aacc-8f5aea0c9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:24.800723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e16e5-87da-44b3-aacc-8f5aea0c9a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:24.801430 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e16e5-87da-44b3-aacc-8f5aea0c9a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:37:24.801735 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e16e5-87da-44b3-aacc-8f5aea0c9a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:24.803367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e16e5-87da-44b3-aacc-8f5aea0c9a4a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:24.815267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1378/2714] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:37:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:37:24.819781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c923ccf-e75c-4576-8a53-cfa71efe06dc None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:24.829299 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c923ccf-e75c-4576-8a53-cfa71efe06dc None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:24.833878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e5a1c-8752-47c9-91a1-88f228637fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:24.834511 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5a1c-8752-47c9-91a1-88f228637fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:24.834835 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5a1c-8752-47c9-91a1-88f228637fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:24.835114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5a1c-8752-47c9-91a1-88f228637fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:24.835787 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e5a1c-8752-47c9-91a1-88f228637fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:24.837657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e5a1c-8752-47c9-91a1-88f228637fd5 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:24.862794 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1337/2715] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:37:24 2021] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:24.867267 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e16e5-87da-44b3-aacc-8f5aea0c9a4a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:24.877517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e16e5-87da-44b3-aacc-8f5aea0c9a4a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:24.930286 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeef4d-4349-4855-add4-5289a8d72b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:24.930975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeef4d-4349-4855-add4-5289a8d72b62 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:24.931259 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeef4d-4349-4855-add4-5289a8d72b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:24.931537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeef4d-4349-4855-add4-5289a8d72b62 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:24.932394 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faeef4d-4349-4855-add4-5289a8d72b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:24.934333 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faeef4d-4349-4855-add4-5289a8d72b62 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:24.954371 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1379/2716] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:37:24 2021] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:37:24.958390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e5a1c-8752-47c9-91a1-88f228637fd5 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:24.968301 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e5a1c-8752-47c9-91a1-88f228637fd5 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:24.972823 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33275469-9dc5-4b24-8509-141aa1b83dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:24.973469 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33275469-9dc5-4b24-8509-141aa1b83dbf admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:24.973852 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33275469-9dc5-4b24-8509-141aa1b83dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:24.974133 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33275469-9dc5-4b24-8509-141aa1b83dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:24.974885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33275469-9dc5-4b24-8509-141aa1b83dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:24.976486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33275469-9dc5-4b24-8509-141aa1b83dbf admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:24.986582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1338/2717] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:24 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:37:24.990055 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeef4d-4349-4855-add4-5289a8d72b62 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:25.000208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeef4d-4349-4855-add4-5289a8d72b62 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:25.004786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb01b3b-2cd8-42b7-b28c-61c4b9a325ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:25.005429 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb01b3b-2cd8-42b7-b28c-61c4b9a325ac admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.005715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb01b3b-2cd8-42b7-b28c-61c4b9a325ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.005993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb01b3b-2cd8-42b7-b28c-61c4b9a325ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.006824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb01b3b-2cd8-42b7-b28c-61c4b9a325ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:25.008678 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb01b3b-2cd8-42b7-b28c-61c4b9a325ac admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:25.018295 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1380/2718] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:25.022167 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33275469-9dc5-4b24-8509-141aa1b83dbf admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:25.032420 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33275469-9dc5-4b24-8509-141aa1b83dbf admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:25.036987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ded4ec-17f7-4284-b593-790f0b93a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:25.037844 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded4ec-17f7-4284-b593-790f0b93a3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.038127 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded4ec-17f7-4284-b593-790f0b93a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.038403 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded4ec-17f7-4284-b593-790f0b93a3ee admin admin] PATH_INFO: `/v3/projects/b37dc2f8a1fb4db88edd7b412bafd55b/users/73f0106a0cd445d289ec919204359110/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.052894 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ded4ec-17f7-4284-b593-790f0b93a3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37dc2f8a1fb4db88edd7b412bafd55b, user_id=73f0106a0cd445d289ec919204359110, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:25.055557 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ded4ec-17f7-4284-b593-790f0b93a3ee admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:25.067768 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1339/2719] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:25 2021] PUT /identity/v3/projects/b37dc2f8a1fb4db88edd7b412bafd55b/users/73f0106a0cd445d289ec919204359110/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:25.078924 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ea601-0b87-4e09-9c67-55f8edd8e864 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.079216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ea601-0b87-4e09-9c67-55f8edd8e864 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.079494 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ea601-0b87-4e09-9c67-55f8edd8e864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.105525 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-f45ea601-0b87-4e09-9c67-55f8edd8e864 None None] MFA Rules not processed for user `73f0106a0cd445d289ec919204359110`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:25.106764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-f45ea601-0b87-4e09-9c67-55f8edd8e864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:25.167812 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1381/2720] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:25 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:25.172254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ded4ec-17f7-4284-b593-790f0b93a3ee admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:25.229499 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ded4ec-17f7-4284-b593-790f0b93a3ee admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:25.234058 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1a01-0f08-4c76-bbe2-bbc5662a3058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:25.234714 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1a01-0f08-4c76-bbe2-bbc5662a3058 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.235004 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1a01-0f08-4c76-bbe2-bbc5662a3058 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.235278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1a01-0f08-4c76-bbe2-bbc5662a3058 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.235940 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1a01-0f08-4c76-bbe2-bbc5662a3058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:25.237837 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1a01-0f08-4c76-bbe2-bbc5662a3058 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:25.261000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1340/2721] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:37:25 2021] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:25.265537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ea601-0b87-4e09-9c67-55f8edd8e864 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:25.275873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ea601-0b87-4e09-9c67-55f8edd8e864 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:25.328851 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1db35d-72bf-4b5b-bd4c-ec26bd76515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:25.329477 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1db35d-72bf-4b5b-bd4c-ec26bd76515e admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.329762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1db35d-72bf-4b5b-bd4c-ec26bd76515e admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.330063 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1db35d-72bf-4b5b-bd4c-ec26bd76515e admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.330775 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1db35d-72bf-4b5b-bd4c-ec26bd76515e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:25.333030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1db35d-72bf-4b5b-bd4c-ec26bd76515e admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:25.352530 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1382/2722] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:37:25 2021] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:25.356448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1a01-0f08-4c76-bbe2-bbc5662a3058 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:25.366465 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1a01-0f08-4c76-bbe2-bbc5662a3058 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:25.371132 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b533c0-ad52-4531-a450-efb71733049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:25.371782 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b533c0-ad52-4531-a450-efb71733049f admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.372068 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b533c0-ad52-4531-a450-efb71733049f admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.372348 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b533c0-ad52-4531-a450-efb71733049f admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.373067 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b533c0-ad52-4531-a450-efb71733049f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:25.374636 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b533c0-ad52-4531-a450-efb71733049f admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:25.385289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1341/2723] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:25.389517 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1db35d-72bf-4b5b-bd4c-ec26bd76515e admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:25.399219 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1db35d-72bf-4b5b-bd4c-ec26bd76515e admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:25.403780 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341785ee-9c82-4a56-9ff2-a13444ca3bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:25.405300 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341785ee-9c82-4a56-9ff2-a13444ca3bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.405584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341785ee-9c82-4a56-9ff2-a13444ca3bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.405862 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341785ee-9c82-4a56-9ff2-a13444ca3bcf admin admin] PATH_INFO: `/v3/projects/52871c69c5104b568ba111b38349be40/users/fea3e0ec0e0b4d3f9f3e4695658baca8/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.419881 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341785ee-9c82-4a56-9ff2-a13444ca3bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=52871c69c5104b568ba111b38349be40, user_id=fea3e0ec0e0b4d3f9f3e4695658baca8, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:25.422519 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341785ee-9c82-4a56-9ff2-a13444ca3bcf admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:25.434980 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1383/2724] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:25 2021] PUT /identity/v3/projects/52871c69c5104b568ba111b38349be40/users/fea3e0ec0e0b4d3f9f3e4695658baca8/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:25.439331 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b533c0-ad52-4531-a450-efb71733049f admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:25.448997 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b533c0-ad52-4531-a450-efb71733049f admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:25.502734 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af0f33-1d42-4d43-9732-fe819916e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:25.503410 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0f33-1d42-4d43-9732-fe819916e4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.503697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0f33-1d42-4d43-9732-fe819916e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.503974 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0f33-1d42-4d43-9732-fe819916e4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.504697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af0f33-1d42-4d43-9732-fe819916e4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:25.506278 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af0f33-1d42-4d43-9732-fe819916e4c8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:25.516822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1342/2725] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:25 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:25.520884 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341785ee-9c82-4a56-9ff2-a13444ca3bcf admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:25.531347 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341785ee-9c82-4a56-9ff2-a13444ca3bcf admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:25.535948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa84492-a631-4d04-a0be-2a713cdc8877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:25.536821 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa84492-a631-4d04-a0be-2a713cdc8877 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.537101 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa84492-a631-4d04-a0be-2a713cdc8877 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.537377 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa84492-a631-4d04-a0be-2a713cdc8877 admin admin] PATH_INFO: `/v3/projects/52871c69c5104b568ba111b38349be40/users/fea3e0ec0e0b4d3f9f3e4695658baca8/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.539355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa84492-a631-4d04-a0be-2a713cdc8877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52871c69c5104b568ba111b38349be40, user_id=fea3e0ec0e0b4d3f9f3e4695658baca8, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:25.541981 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa84492-a631-4d04-a0be-2a713cdc8877 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:25.551857 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1384/2726] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:25 2021] PUT /identity/v3/projects/52871c69c5104b568ba111b38349be40/users/fea3e0ec0e0b4d3f9f3e4695658baca8/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:25.562267 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8b957-ce85-4be3-8a55-2478496cbea4 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.562559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8b957-ce85-4be3-8a55-2478496cbea4 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.563011 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8b957-ce85-4be3-8a55-2478496cbea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.588307 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-86a8b957-ce85-4be3-8a55-2478496cbea4 None None] MFA Rules not processed for user `fea3e0ec0e0b4d3f9f3e4695658baca8`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:25.589433 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-86a8b957-ce85-4be3-8a55-2478496cbea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:25.653804 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1343/2727] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:25 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:25.664279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa84492-a631-4d04-a0be-2a713cdc8877 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:25.665960 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-cfa84492-a631-4d04-a0be-2a713cdc8877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:25.721650 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa84492-a631-4d04-a0be-2a713cdc8877 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:25.725528 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31fbf6-0950-42bc-896f-6b0c2fa5980e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:25.726177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31fbf6-0950-42bc-896f-6b0c2fa5980e service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.726490 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31fbf6-0950-42bc-896f-6b0c2fa5980e service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.726793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31fbf6-0950-42bc-896f-6b0c2fa5980e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.735797 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31fbf6-0950-42bc-896f-6b0c2fa5980e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:25.737223 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31fbf6-0950-42bc-896f-6b0c2fa5980e service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:25.746655 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1385/2728] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:25 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:37:25.813710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8b957-ce85-4be3-8a55-2478496cbea4 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:25.823195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8b957-ce85-4be3-8a55-2478496cbea4 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:25.827017 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea812b-5cd2-4cdc-95e1-730e35fa4d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:25.827676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea812b-5cd2-4cdc-95e1-730e35fa4d7c service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:25.827957 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea812b-5cd2-4cdc-95e1-730e35fa4d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:25.828229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea812b-5cd2-4cdc-95e1-730e35fa4d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:25.882000 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea812b-5cd2-4cdc-95e1-730e35fa4d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:25.883635 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea812b-5cd2-4cdc-95e1-730e35fa4d7c service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:25.892492 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1344/2729] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:25 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:31.190385 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31fbf6-0950-42bc-896f-6b0c2fa5980e service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:31.191759 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-9a31fbf6-0950-42bc-896f-6b0c2fa5980e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:31.202632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31fbf6-0950-42bc-896f-6b0c2fa5980e service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:31.206180 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876cafc-115a-471a-a086-a428c9952a3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:31.208473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876cafc-115a-471a-a086-a428c9952a3f service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:31.208473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876cafc-115a-471a-a086-a428c9952a3f service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:31.208473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876cafc-115a-471a-a086-a428c9952a3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:31.209789 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e876cafc-115a-471a-a086-a428c9952a3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:31.266339 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876cafc-115a-471a-a086-a428c9952a3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:31.267804 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876cafc-115a-471a-a086-a428c9952a3f service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:31.276360 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1386/2730] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:38.038239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65cb30-e451-4ba7-b341-0430cf78e8f1 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:38.038766 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65cb30-e451-4ba7-b341-0430cf78e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:38.038857 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65cb30-e451-4ba7-b341-0430cf78e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:38.057781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-5b65cb30-e451-4ba7-b341-0430cf78e8f1 None None] MFA Rules not processed for user `2fba46fcf5a742d28b39d9fef9c91df5`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:38.059044 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5b65cb30-e451-4ba7-b341-0430cf78e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:38.067622 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1345/2731] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:38 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:38.103243 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876cafc-115a-471a-a086-a428c9952a3f service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:38.112933 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876cafc-115a-471a-a086-a428c9952a3f service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:38.116597 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b080-67c0-4f5c-8d98-cf31c365e137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:38.117228 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b080-67c0-4f5c-8d98-cf31c365e137 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:38.117511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b080-67c0-4f5c-8d98-cf31c365e137 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:38.117788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b080-67c0-4f5c-8d98-cf31c365e137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:38.119531 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-8982b080-67c0-4f5c-8d98-cf31c365e137 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:38.188431 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b080-67c0-4f5c-8d98-cf31c365e137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:38.189856 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b080-67c0-4f5c-8d98-cf31c365e137 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:38.200456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1387/2732] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:38.893373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65cb30-e451-4ba7-b341-0430cf78e8f1 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:38.894668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-5b65cb30-e451-4ba7-b341-0430cf78e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:38.952928 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65cb30-e451-4ba7-b341-0430cf78e8f1 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:38.957056 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e32b7-3f25-44de-a54f-1f275b0cb5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:38.957703 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e32b7-3f25-44de-a54f-1f275b0cb5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:38.957988 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e32b7-3f25-44de-a54f-1f275b0cb5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:38.958360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e32b7-3f25-44de-a54f-1f275b0cb5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:38.960048 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-203e32b7-3f25-44de-a54f-1f275b0cb5d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:38.974593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e32b7-3f25-44de-a54f-1f275b0cb5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:38.976057 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e32b7-3f25-44de-a54f-1f275b0cb5d0 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:39.000202 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1346/2733] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:39.125075 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b080-67c0-4f5c-8d98-cf31c365e137 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:39.188769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b080-67c0-4f5c-8d98-cf31c365e137 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:39.193900 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:39.194781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:39.195070 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:39.195379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] PATH_INFO: `/v3/users/73f0106a0cd445d289ec919204359110` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:39.196567 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f0106a0cd445d289ec919204359110)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:39.198496 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:39.245872 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f0106a0cd445d289ec919204359110'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:39.258364 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f0106a0cd445d289ec919204359110'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:39.259074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f0106a0cd445d289ec919204359110'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:39.265793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f0106a0cd445d289ec919204359110'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:39.266474 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f0106a0cd445d289ec919204359110'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:39.279761 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1388/2734] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:37:39 2021] DELETE /identity/v3/users/73f0106a0cd445d289ec919204359110 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:39.284827 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeccca-2c6d-47e5-be8e-6c9ad4b4d610 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:39.285305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeccca-2c6d-47e5-be8e-6c9ad4b4d610 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:39.285406 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeccca-2c6d-47e5-be8e-6c9ad4b4d610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:39.302520 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-f4eeccca-2c6d-47e5-be8e-6c9ad4b4d610 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:39.303743 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f4eeccca-2c6d-47e5-be8e-6c9ad4b4d610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:39.364398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1347/2735] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:39.374523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:39.376556 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:39.432662 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd1cd0-6f04-4bc3-be0d-e1d0e0c9e4cd admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:39.436867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431614a-49d7-46d6-a3ea-fc14b75b5227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:39.437574 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431614a-49d7-46d6-a3ea-fc14b75b5227 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:39.437861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431614a-49d7-46d6-a3ea-fc14b75b5227 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:39.438802 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431614a-49d7-46d6-a3ea-fc14b75b5227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:39.447755 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431614a-49d7-46d6-a3ea-fc14b75b5227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:39.449179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431614a-49d7-46d6-a3ea-fc14b75b5227 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:39.458414 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1389/2736] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:39.746257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeccca-2c6d-47e5-be8e-6c9ad4b4d610 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:39.747782 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f4eeccca-2c6d-47e5-be8e-6c9ad4b4d610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:39.760289 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeccca-2c6d-47e5-be8e-6c9ad4b4d610 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:39.766366 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:39.767553 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:39.767995 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:39.768428 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] PATH_INFO: `/v3/projects/b37dc2f8a1fb4db88edd7b412bafd55b` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:39.770828 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b37dc2f8a1fb4db88edd7b412bafd55b)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:39.773065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:39.833339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b37dc2f8a1fb4db88edd7b412bafd55b', 'request_id': 'req-8a493d7d-2523-41ea-a7a1-17d81da73854'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:39.843900 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b37dc2f8a1fb4db88edd7b412bafd55b', 'request_id': 'req-8a493d7d-2523-41ea-a7a1-17d81da73854'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:39.850089 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b37dc2f8a1fb4db88edd7b412bafd55b', 'request_id': 'req-8a493d7d-2523-41ea-a7a1-17d81da73854'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:39.863783 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] The token cache is being invalidate because project b37dc2f8a1fb4db88edd7b412bafd55b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:37:39.863982 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:39.864540 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:39.866823 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1348/2737] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:37:39 2021] DELETE /identity/v3/projects/b37dc2f8a1fb4db88edd7b412bafd55b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:39.870459 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431614a-49d7-46d6-a3ea-fc14b75b5227 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:39.881853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431614a-49d7-46d6-a3ea-fc14b75b5227 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:39.939713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:39.940580 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:39.940892 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:39.941168 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] PATH_INFO: `/v3/users/fea3e0ec0e0b4d3f9f3e4695658baca8` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:39.942352 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea3e0ec0e0b4d3f9f3e4695658baca8)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:39.944303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:39.992529 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea3e0ec0e0b4d3f9f3e4695658baca8'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:40.004203 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea3e0ec0e0b4d3f9f3e4695658baca8'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:40.004914 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea3e0ec0e0b4d3f9f3e4695658baca8'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:40.012873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea3e0ec0e0b4d3f9f3e4695658baca8'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:40.013588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-c8c0192e-dc88-4201-8604-033b41a4f21f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea3e0ec0e0b4d3f9f3e4695658baca8'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:40.026660 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1390/2738] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:37:39 2021] DELETE /identity/v3/users/fea3e0ec0e0b4d3f9f3e4695658baca8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:40.347178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:40.349320 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:40.365475 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a493d7d-2523-41ea-a7a1-17d81da73854 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:40.432605 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:40.433498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:40.433779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:40.434052 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] PATH_INFO: `/v3/projects/52871c69c5104b568ba111b38349be40` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:40.436027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52871c69c5104b568ba111b38349be40)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:40.437934 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:40.504087 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52871c69c5104b568ba111b38349be40', 'request_id': 'req-727012b0-eb11-486e-9f52-100d9de1b5a1'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:40.514417 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52871c69c5104b568ba111b38349be40', 'request_id': 'req-727012b0-eb11-486e-9f52-100d9de1b5a1'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:40.520874 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52871c69c5104b568ba111b38349be40', 'request_id': 'req-727012b0-eb11-486e-9f52-100d9de1b5a1'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:40.537312 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] The token cache is being invalidate because project 52871c69c5104b568ba111b38349be40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:37:40.537824 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:40.538457 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-727012b0-eb11-486e-9f52-100d9de1b5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:40.540045 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1349/2739] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:37:40 2021] DELETE /identity/v3/projects/52871c69c5104b568ba111b38349be40 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:40.545920 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001783-2c27-4e93-94da-a5e981434751 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:40.546467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001783-2c27-4e93-94da-a5e981434751 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:40.546467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001783-2c27-4e93-94da-a5e981434751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:40.565879 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-ea001783-2c27-4e93-94da-a5e981434751 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:40.567321 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-ea001783-2c27-4e93-94da-a5e981434751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:40.632552 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1391/2740] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:40.640448 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ec772-d51a-4065-a3a9-e562464558ca None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:40.640759 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ec772-d51a-4065-a3a9-e562464558ca None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:40.641039 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ec772-d51a-4065-a3a9-e562464558ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:40.661332 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-1c0ec772-d51a-4065-a3a9-e562464558ca None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:40.662964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1c0ec772-d51a-4065-a3a9-e562464558ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:40.672548 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1350/2741] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:40.676449 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea001783-2c27-4e93-94da-a5e981434751 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:40.686046 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea001783-2c27-4e93-94da-a5e981434751 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:40.691669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226cec6-0ddd-45f6-bcde-b955ddb6d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:40.692446 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226cec6-0ddd-45f6-bcde-b955ddb6d53b admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:40.692833 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226cec6-0ddd-45f6-bcde-b955ddb6d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:40.693215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226cec6-0ddd-45f6-bcde-b955ddb6d53b admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:40.694037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226cec6-0ddd-45f6-bcde-b955ddb6d53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:37:40.694441 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226cec6-0ddd-45f6-bcde-b955ddb6d53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:40.696172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226cec6-0ddd-45f6-bcde-b955ddb6d53b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:40.712334 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1392/2742] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:37:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:37:40.716651 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ec772-d51a-4065-a3a9-e562464558ca None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:40.725684 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ec772-d51a-4065-a3a9-e562464558ca None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:40.730208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af285f7-60e0-430b-a5ac-fa553ce81fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:40.730876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af285f7-60e0-430b-a5ac-fa553ce81fac admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:40.731158 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af285f7-60e0-430b-a5ac-fa553ce81fac admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:40.731430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af285f7-60e0-430b-a5ac-fa553ce81fac admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:40.732233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af285f7-60e0-430b-a5ac-fa553ce81fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:40.734104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af285f7-60e0-430b-a5ac-fa553ce81fac admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:40.759843 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1351/2743] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:37:40 2021] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:40.763975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226cec6-0ddd-45f6-bcde-b955ddb6d53b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:40.773917 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226cec6-0ddd-45f6-bcde-b955ddb6d53b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:40.828215 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162abb57-cc30-41d8-9952-e797374ca60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:40.828901 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162abb57-cc30-41d8-9952-e797374ca60b admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:40.829189 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162abb57-cc30-41d8-9952-e797374ca60b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:40.829469 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162abb57-cc30-41d8-9952-e797374ca60b admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:40.830157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162abb57-cc30-41d8-9952-e797374ca60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:40.832094 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162abb57-cc30-41d8-9952-e797374ca60b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:40.854915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1393/2744] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:37:40 2021] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:37:40.856088 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af285f7-60e0-430b-a5ac-fa553ce81fac admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:40.869070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af285f7-60e0-430b-a5ac-fa553ce81fac admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:40.874455 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c613f2-dd95-401f-bb73-41d728cc36ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:40.875143 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c613f2-dd95-401f-bb73-41d728cc36ea admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:40.875422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c613f2-dd95-401f-bb73-41d728cc36ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:40.876237 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c613f2-dd95-401f-bb73-41d728cc36ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:40.876959 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c613f2-dd95-401f-bb73-41d728cc36ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:40.878532 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c613f2-dd95-401f-bb73-41d728cc36ea admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:40.889399 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1352/2745] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:40 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:37:40.893523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162abb57-cc30-41d8-9952-e797374ca60b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:40.903303 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162abb57-cc30-41d8-9952-e797374ca60b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:40.908109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640af6c4-73c9-4775-9811-f32e44c138ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:40.908873 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640af6c4-73c9-4775-9811-f32e44c138ea admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:40.909049 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640af6c4-73c9-4775-9811-f32e44c138ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:40.909324 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640af6c4-73c9-4775-9811-f32e44c138ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:40.910050 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640af6c4-73c9-4775-9811-f32e44c138ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:40.911694 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640af6c4-73c9-4775-9811-f32e44c138ea admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:40.922995 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1394/2746] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:40 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:40.926936 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c613f2-dd95-401f-bb73-41d728cc36ea admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:40.942183 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c613f2-dd95-401f-bb73-41d728cc36ea admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:40.947104 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e779acd-2477-4d03-8d87-e907f4674f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:40.948311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e779acd-2477-4d03-8d87-e907f4674f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:40.948700 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e779acd-2477-4d03-8d87-e907f4674f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:40.949072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e779acd-2477-4d03-8d87-e907f4674f71 admin admin] PATH_INFO: `/v3/projects/7d6a8cf5ea804895a6721897e3e8d9c0/users/d35e5665da354aa7813682b6a7a50976/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:40.966162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e779acd-2477-4d03-8d87-e907f4674f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d6a8cf5ea804895a6721897e3e8d9c0, user_id=d35e5665da354aa7813682b6a7a50976, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:40.969034 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e779acd-2477-4d03-8d87-e907f4674f71 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:40.987416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1353/2747] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:40 2021] PUT /identity/v3/projects/7d6a8cf5ea804895a6721897e3e8d9c0/users/d35e5665da354aa7813682b6a7a50976/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:40.998512 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee26477-975a-4c08-9c67-9198d53ee613 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:40.998956 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee26477-975a-4c08-9c67-9198d53ee613 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:40.999747 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee26477-975a-4c08-9c67-9198d53ee613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:41.029035 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-fee26477-975a-4c08-9c67-9198d53ee613 None None] MFA Rules not processed for user `d35e5665da354aa7813682b6a7a50976`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:41.030762 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fee26477-975a-4c08-9c67-9198d53ee613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:41.101195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1395/2748] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:40 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:41.105624 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e779acd-2477-4d03-8d87-e907f4674f71 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:41.204903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e779acd-2477-4d03-8d87-e907f4674f71 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:41.216489 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4476b4b-5f71-48d6-80ed-752e96c73e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:41.216984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4476b4b-5f71-48d6-80ed-752e96c73e20 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:41.217270 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4476b4b-5f71-48d6-80ed-752e96c73e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:41.217544 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4476b4b-5f71-48d6-80ed-752e96c73e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:41.218251 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4476b4b-5f71-48d6-80ed-752e96c73e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:41.220923 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4476b4b-5f71-48d6-80ed-752e96c73e20 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:41.260650 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1354/2749] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:37:41 2021] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:41.261795 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee26477-975a-4c08-9c67-9198d53ee613 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:41.275400 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee26477-975a-4c08-9c67-9198d53ee613 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:41.342511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d0a0f-0a0f-480d-9281-0c8ce2391ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:41.343281 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d0a0f-0a0f-480d-9281-0c8ce2391ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:41.343572 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d0a0f-0a0f-480d-9281-0c8ce2391ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:41.343855 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d0a0f-0a0f-480d-9281-0c8ce2391ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:41.345103 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d0a0f-0a0f-480d-9281-0c8ce2391ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:41.347074 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d0a0f-0a0f-480d-9281-0c8ce2391ba5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:41.373726 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1396/2750] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:37:41 2021] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:41.377552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4476b4b-5f71-48d6-80ed-752e96c73e20 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:41.387949 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4476b4b-5f71-48d6-80ed-752e96c73e20 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:41.392987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135d976-9281-4201-a936-8076ad9b12b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:41.393652 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135d976-9281-4201-a936-8076ad9b12b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:41.393984 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135d976-9281-4201-a936-8076ad9b12b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:41.394259 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135d976-9281-4201-a936-8076ad9b12b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:41.395013 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135d976-9281-4201-a936-8076ad9b12b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:41.396619 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135d976-9281-4201-a936-8076ad9b12b7 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:41.407584 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1355/2751] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:37:41.411708 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d0a0f-0a0f-480d-9281-0c8ce2391ba5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:41.421738 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d0a0f-0a0f-480d-9281-0c8ce2391ba5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:41.427015 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c489c1-443e-45bb-b065-fd2527556ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:41.427898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c489c1-443e-45bb-b065-fd2527556ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:41.428177 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c489c1-443e-45bb-b065-fd2527556ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:41.428451 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c489c1-443e-45bb-b065-fd2527556ba5 admin admin] PATH_INFO: `/v3/projects/3804ad5fe0c446bc928bd9784a8570ea/users/85b6b1f507874c7b8dfe8fab3cd3967a/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:41.442893 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c489c1-443e-45bb-b065-fd2527556ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3804ad5fe0c446bc928bd9784a8570ea, user_id=85b6b1f507874c7b8dfe8fab3cd3967a, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:41.445547 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c489c1-443e-45bb-b065-fd2527556ba5 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:41.459157 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1397/2752] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:41 2021] PUT /identity/v3/projects/3804ad5fe0c446bc928bd9784a8570ea/users/85b6b1f507874c7b8dfe8fab3cd3967a/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:41.463188 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135d976-9281-4201-a936-8076ad9b12b7 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:41.473507 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135d976-9281-4201-a936-8076ad9b12b7 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:41.528626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca970a-3a3a-40cd-97fb-18bf13631d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:41.529217 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca970a-3a3a-40cd-97fb-18bf13631d40 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:41.529500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca970a-3a3a-40cd-97fb-18bf13631d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:41.529779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca970a-3a3a-40cd-97fb-18bf13631d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:41.530502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca970a-3a3a-40cd-97fb-18bf13631d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:41.532686 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca970a-3a3a-40cd-97fb-18bf13631d40 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:41.545657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1356/2753] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:41.547018 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c489c1-443e-45bb-b065-fd2527556ba5 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:41.557128 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c489c1-443e-45bb-b065-fd2527556ba5 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:41.561633 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175b6e8-1c14-47a8-89bb-fd3c9f788ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:41.562754 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b6e8-1c14-47a8-89bb-fd3c9f788ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:41.563076 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b6e8-1c14-47a8-89bb-fd3c9f788ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:41.563353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b6e8-1c14-47a8-89bb-fd3c9f788ad1 admin admin] PATH_INFO: `/v3/projects/3804ad5fe0c446bc928bd9784a8570ea/users/85b6b1f507874c7b8dfe8fab3cd3967a/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:41.565308 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175b6e8-1c14-47a8-89bb-fd3c9f788ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3804ad5fe0c446bc928bd9784a8570ea, user_id=85b6b1f507874c7b8dfe8fab3cd3967a, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:41.567975 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175b6e8-1c14-47a8-89bb-fd3c9f788ad1 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:41.578271 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1398/2754] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:41 2021] PUT /identity/v3/projects/3804ad5fe0c446bc928bd9784a8570ea/users/85b6b1f507874c7b8dfe8fab3cd3967a/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:41.588955 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf9acb-0ae3-4580-bdec-eb4dcbc46f0e None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:41.589243 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf9acb-0ae3-4580-bdec-eb4dcbc46f0e None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:41.589518 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf9acb-0ae3-4580-bdec-eb4dcbc46f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:41.617884 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-6ccf9acb-0ae3-4580-bdec-eb4dcbc46f0e None None] MFA Rules not processed for user `85b6b1f507874c7b8dfe8fab3cd3967a`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:41.619120 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-6ccf9acb-0ae3-4580-bdec-eb4dcbc46f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:41.686742 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1357/2755] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:41 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:41.696601 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175b6e8-1c14-47a8-89bb-fd3c9f788ad1 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:41.698292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-5175b6e8-1c14-47a8-89bb-fd3c9f788ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:41.753142 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175b6e8-1c14-47a8-89bb-fd3c9f788ad1 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:41.756858 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32724c96-8fd1-4fe7-bf2b-55b41733508d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:41.757503 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724c96-8fd1-4fe7-bf2b-55b41733508d service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:41.758030 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724c96-8fd1-4fe7-bf2b-55b41733508d service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:41.758315 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724c96-8fd1-4fe7-bf2b-55b41733508d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:41.767845 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32724c96-8fd1-4fe7-bf2b-55b41733508d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:41.769269 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32724c96-8fd1-4fe7-bf2b-55b41733508d service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:41.778736 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1399/2756] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:41 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:42.976710 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf9acb-0ae3-4580-bdec-eb4dcbc46f0e None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:43.037204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf9acb-0ae3-4580-bdec-eb4dcbc46f0e None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:43.041801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:43.042648 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:43.042964 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:43.043245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] PATH_INFO: `/v3/users/d35e5665da354aa7813682b6a7a50976` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:43.044416 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35e5665da354aa7813682b6a7a50976)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:43.046318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:43.089921 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35e5665da354aa7813682b6a7a50976'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.096905 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35e5665da354aa7813682b6a7a50976'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.097555 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35e5665da354aa7813682b6a7a50976'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.098146 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35e5665da354aa7813682b6a7a50976'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.104365 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35e5665da354aa7813682b6a7a50976'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.120668 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1358/2757] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:37:42 2021] DELETE /identity/v3/users/d35e5665da354aa7813682b6a7a50976 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:43.125155 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dde82f-93e1-4851-bbd3-16701f1c059a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:43.125632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dde82f-93e1-4851-bbd3-16701f1c059a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:43.125925 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dde82f-93e1-4851-bbd3-16701f1c059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:43.143768 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a6dde82f-93e1-4851-bbd3-16701f1c059a None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:43.144955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a6dde82f-93e1-4851-bbd3-16701f1c059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:43.199638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1400/2758] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:43.209811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:43.211214 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:43.264885 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e51e0-b34a-4129-a207-ae3c4496b98e admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:43.269023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28390128-0984-4f90-9884-b73d306b9be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:43.269655 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390128-0984-4f90-9884-b73d306b9be4 service neutron] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:43.269937 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390128-0984-4f90-9884-b73d306b9be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:43.270212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390128-0984-4f90-9884-b73d306b9be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:43.278933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28390128-0984-4f90-9884-b73d306b9be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:43.280388 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28390128-0984-4f90-9884-b73d306b9be4 service neutron] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:43.290114 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1359/2759] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:43.556069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dde82f-93e1-4851-bbd3-16701f1c059a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:43.557618 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a6dde82f-93e1-4851-bbd3-16701f1c059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:43.570493 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dde82f-93e1-4851-bbd3-16701f1c059a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:43.575619 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:43.576485 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:43.576772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:43.577051 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] PATH_INFO: `/v3/projects/7d6a8cf5ea804895a6721897e3e8d9c0` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:43.578226 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d6a8cf5ea804895a6721897e3e8d9c0)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:43.580840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:43.627068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d6a8cf5ea804895a6721897e3e8d9c0', 'request_id': 'req-da969685-c8ed-41f4-aa8c-1e44f99f109b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.633292 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d6a8cf5ea804895a6721897e3e8d9c0', 'request_id': 'req-da969685-c8ed-41f4-aa8c-1e44f99f109b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.638582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d6a8cf5ea804895a6721897e3e8d9c0', 'request_id': 'req-da969685-c8ed-41f4-aa8c-1e44f99f109b'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.651606 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] The token cache is being invalidate because project 7d6a8cf5ea804895a6721897e3e8d9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:37:43.652023 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.652691 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.654298 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1401/2760] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:37:43 2021] DELETE /identity/v3/projects/7d6a8cf5ea804895a6721897e3e8d9c0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:43.658215 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28390128-0984-4f90-9884-b73d306b9be4 service neutron] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:43.667609 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28390128-0984-4f90-9884-b73d306b9be4 service neutron] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:43.722011 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:43.722898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:43.723187 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:43.723466 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] PATH_INFO: `/v3/users/85b6b1f507874c7b8dfe8fab3cd3967a` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:43.724643 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b6b1f507874c7b8dfe8fab3cd3967a)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:43.726535 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:43.769265 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b6b1f507874c7b8dfe8fab3cd3967a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.775920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b6b1f507874c7b8dfe8fab3cd3967a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.776564 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b6b1f507874c7b8dfe8fab3cd3967a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.777181 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b6b1f507874c7b8dfe8fab3cd3967a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.783781 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-0943a41a-6120-44a3-825c-e629911b328a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b6b1f507874c7b8dfe8fab3cd3967a'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:43.802744 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1360/2761] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:37:43 2021] DELETE /identity/v3/users/85b6b1f507874c7b8dfe8fab3cd3967a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:44.075582 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.077109 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:44.091674 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da969685-c8ed-41f4-aa8c-1e44f99f109b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.148263 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.149123 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.149401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.149674 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] PATH_INFO: `/v3/projects/3804ad5fe0c446bc928bd9784a8570ea` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.150867 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3804ad5fe0c446bc928bd9784a8570ea)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.152773 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.197068 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3804ad5fe0c446bc928bd9784a8570ea', 'request_id': 'req-5b72f168-035a-4428-81de-9a43a88f7745'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:44.203022 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3804ad5fe0c446bc928bd9784a8570ea', 'request_id': 'req-5b72f168-035a-4428-81de-9a43a88f7745'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:44.208481 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3804ad5fe0c446bc928bd9784a8570ea', 'request_id': 'req-5b72f168-035a-4428-81de-9a43a88f7745'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:44.220353 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] The token cache is being invalidate because project 3804ad5fe0c446bc928bd9784a8570ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:37:44.220640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:44.221250 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-5b72f168-035a-4428-81de-9a43a88f7745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:44.222748 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1402/2762] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:37:44 2021] DELETE /identity/v3/projects/3804ad5fe0c446bc928bd9784a8570ea => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:44.228393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920af3d0-33a1-48e9-978e-cdf8b86fce03 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.228879 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920af3d0-33a1-48e9-978e-cdf8b86fce03 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.229003 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920af3d0-33a1-48e9-978e-cdf8b86fce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.246878 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-920af3d0-33a1-48e9-978e-cdf8b86fce03 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:44.248074 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-920af3d0-33a1-48e9-978e-cdf8b86fce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:44.303806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1361/2763] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:44.312550 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfe9a1-c533-46a3-8d4f-f6d4b277554c None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.312846 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfe9a1-c533-46a3-8d4f-f6d4b277554c None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.313130 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfe9a1-c533-46a3-8d4f-f6d4b277554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.331588 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-1ddfe9a1-c533-46a3-8d4f-f6d4b277554c None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:44.332781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-1ddfe9a1-c533-46a3-8d4f-f6d4b277554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:44.341252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1403/2764] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:44.346577 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920af3d0-33a1-48e9-978e-cdf8b86fce03 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.356099 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920af3d0-33a1-48e9-978e-cdf8b86fce03 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.361277 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d78e8b-9707-4eca-8ed5-4502f220134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.361922 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78e8b-9707-4eca-8ed5-4502f220134c admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.362204 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78e8b-9707-4eca-8ed5-4502f220134c admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.362479 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78e8b-9707-4eca-8ed5-4502f220134c admin admin] PATH_INFO: `/v3/domains` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.363233 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d78e8b-9707-4eca-8ed5-4502f220134c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:37:44.363543 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d78e8b-9707-4eca-8ed5-4502f220134c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.365130 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d78e8b-9707-4eca-8ed5-4502f220134c admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.376632 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1362/2765] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:37:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:37:44.380864 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfe9a1-c533-46a3-8d4f-f6d4b277554c None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.390117 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfe9a1-c533-46a3-8d4f-f6d4b277554c None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.394709 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79277663-7e5c-4d78-9cf6-c728c47219ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.395361 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79277663-7e5c-4d78-9cf6-c728c47219ba admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.395643 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79277663-7e5c-4d78-9cf6-c728c47219ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.395915 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79277663-7e5c-4d78-9cf6-c728c47219ba admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.396599 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79277663-7e5c-4d78-9cf6-c728c47219ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.398473 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79277663-7e5c-4d78-9cf6-c728c47219ba admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.428432 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1404/2766] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:37:44 2021] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:37:44.432400 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d78e8b-9707-4eca-8ed5-4502f220134c admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.442065 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d78e8b-9707-4eca-8ed5-4502f220134c admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.495276 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bb190-4f29-48c0-8b37-ae9bb197093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.495858 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bb190-4f29-48c0-8b37-ae9bb197093a admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.496136 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bb190-4f29-48c0-8b37-ae9bb197093a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.496407 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bb190-4f29-48c0-8b37-ae9bb197093a admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.497080 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bb190-4f29-48c0-8b37-ae9bb197093a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.499005 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bb190-4f29-48c0-8b37-ae9bb197093a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.518933 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1363/2767] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:37:44 2021] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:44.523188 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79277663-7e5c-4d78-9cf6-c728c47219ba admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.533951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79277663-7e5c-4d78-9cf6-c728c47219ba admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.538561 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49c2b9-3075-43cb-987c-14d008d6f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.539254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49c2b9-3075-43cb-987c-14d008d6f86a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.539540 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49c2b9-3075-43cb-987c-14d008d6f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.539826 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49c2b9-3075-43cb-987c-14d008d6f86a admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.540656 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49c2b9-3075-43cb-987c-14d008d6f86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.542576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49c2b9-3075-43cb-987c-14d008d6f86a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.552791 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1405/2768] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:44.556432 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bb190-4f29-48c0-8b37-ae9bb197093a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.566006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bb190-4f29-48c0-8b37-ae9bb197093a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.570552 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0d66b-5e46-49c5-a58e-87a37b48855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.571226 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0d66b-5e46-49c5-a58e-87a37b48855e admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.571503 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0d66b-5e46-49c5-a58e-87a37b48855e admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.571776 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0d66b-5e46-49c5-a58e-87a37b48855e admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.572487 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0d66b-5e46-49c5-a58e-87a37b48855e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.574072 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0d66b-5e46-49c5-a58e-87a37b48855e admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.584086 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1364/2769] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 01:37:44.587829 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49c2b9-3075-43cb-987c-14d008d6f86a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.598116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49c2b9-3075-43cb-987c-14d008d6f86a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.602742 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650bd90-dea5-4707-aaec-b84e0d83c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.603611 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650bd90-dea5-4707-aaec-b84e0d83c891 admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.603895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650bd90-dea5-4707-aaec-b84e0d83c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.604167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650bd90-dea5-4707-aaec-b84e0d83c891 admin admin] PATH_INFO: `/v3/projects/50880780dedb4657ad78446d60cbd3ed/users/2543d6320bee41fe846fa0deecbfc2fd/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.617955 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650bd90-dea5-4707-aaec-b84e0d83c891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50880780dedb4657ad78446d60cbd3ed, user_id=2543d6320bee41fe846fa0deecbfc2fd, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.620640 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650bd90-dea5-4707-aaec-b84e0d83c891 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.633336 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1406/2770] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:44 2021] PUT /identity/v3/projects/50880780dedb4657ad78446d60cbd3ed/users/2543d6320bee41fe846fa0deecbfc2fd/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:44.643826 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26047b14-afb0-417d-a841-10b6cc652bf2 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.644212 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26047b14-afb0-417d-a841-10b6cc652bf2 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.644560 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26047b14-afb0-417d-a841-10b6cc652bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.670486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-26047b14-afb0-417d-a841-10b6cc652bf2 None None] MFA Rules not processed for user `2543d6320bee41fe846fa0deecbfc2fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:44.671825 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-26047b14-afb0-417d-a841-10b6cc652bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:44.732559 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1365/2771] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:44 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:44.736978 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650bd90-dea5-4707-aaec-b84e0d83c891 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.796798 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650bd90-dea5-4707-aaec-b84e0d83c891 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.801685 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf64450-842f-421b-9131-a7d3c833b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.802337 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf64450-842f-421b-9131-a7d3c833b417 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.802616 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf64450-842f-421b-9131-a7d3c833b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.802920 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf64450-842f-421b-9131-a7d3c833b417 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.803605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf64450-842f-421b-9131-a7d3c833b417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.805502 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf64450-842f-421b-9131-a7d3c833b417 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.831457 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1407/2772] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:37:44 2021] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:44.835558 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26047b14-afb0-417d-a841-10b6cc652bf2 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.849574 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26047b14-afb0-417d-a841-10b6cc652bf2 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.904071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6d05c-33bb-412e-a10b-a40084124a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.904731 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6d05c-33bb-412e-a10b-a40084124a9a admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.905015 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6d05c-33bb-412e-a10b-a40084124a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.905291 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6d05c-33bb-412e-a10b-a40084124a9a admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.905976 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6d05c-33bb-412e-a10b-a40084124a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.907960 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6d05c-33bb-412e-a10b-a40084124a9a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.927832 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1366/2773] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:37:44 2021] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:44.931951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf64450-842f-421b-9131-a7d3c833b417 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.942453 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf64450-842f-421b-9131-a7d3c833b417 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.947071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546b92d-5352-4159-98a7-1e0dfa465d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.947723 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546b92d-5352-4159-98a7-1e0dfa465d0a admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.948009 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546b92d-5352-4159-98a7-1e0dfa465d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.948280 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546b92d-5352-4159-98a7-1e0dfa465d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.948990 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546b92d-5352-4159-98a7-1e0dfa465d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.950572 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546b92d-5352-4159-98a7-1e0dfa465d0a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.961467 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1408/2774] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:44.965481 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6d05c-33bb-412e-a10b-a40084124a9a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:44.975176 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6d05c-33bb-412e-a10b-a40084124a9a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:44.980059 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59480ae-3bc2-4cb5-ab01-4ad9fc0a8823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:44.980707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59480ae-3bc2-4cb5-ab01-4ad9fc0a8823 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:44.980987 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59480ae-3bc2-4cb5-ab01-4ad9fc0a8823 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:44.981260 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59480ae-3bc2-4cb5-ab01-4ad9fc0a8823 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:44.981978 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59480ae-3bc2-4cb5-ab01-4ad9fc0a8823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:44.983573 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59480ae-3bc2-4cb5-ab01-4ad9fc0a8823 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:44.993274 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1367/2775] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:44.997052 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546b92d-5352-4159-98a7-1e0dfa465d0a admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:45.007258 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546b92d-5352-4159-98a7-1e0dfa465d0a admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:45.012069 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a0c71-fe98-4226-9fba-b0eacda2c97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:45.012933 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a0c71-fe98-4226-9fba-b0eacda2c97c admin admin] REQUEST_METHOD: `PUT` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:45.013210 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a0c71-fe98-4226-9fba-b0eacda2c97c admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:45.013487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a0c71-fe98-4226-9fba-b0eacda2c97c admin admin] PATH_INFO: `/v3/projects/d9cd7bd550a1440faaed5b0dabf1671c/users/8274ee94ad2f4449b978fbf7e6c15d3e/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:45.027824 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a0c71-fe98-4226-9fba-b0eacda2c97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cd7bd550a1440faaed5b0dabf1671c, user_id=8274ee94ad2f4449b978fbf7e6c15d3e, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:45.030439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a0c71-fe98-4226-9fba-b0eacda2c97c admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:45.042641 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1409/2776] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:44 2021] PUT /identity/v3/projects/d9cd7bd550a1440faaed5b0dabf1671c/users/8274ee94ad2f4449b978fbf7e6c15d3e/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:45.052712 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76064ce4-1bba-40de-b04b-dc5387f98e06 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:45.053012 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76064ce4-1bba-40de-b04b-dc5387f98e06 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:45.053311 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76064ce4-1bba-40de-b04b-dc5387f98e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:45.079370 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-76064ce4-1bba-40de-b04b-dc5387f98e06 None None] MFA Rules not processed for user `8274ee94ad2f4449b978fbf7e6c15d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:45.080572 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-76064ce4-1bba-40de-b04b-dc5387f98e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:45.143430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1368/2777] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:45 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:45.147782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a0c71-fe98-4226-9fba-b0eacda2c97c admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:45.206570 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a0c71-fe98-4226-9fba-b0eacda2c97c admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:45.211240 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51083d88-8899-47a4-bb4a-a935569e2001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:45.211885 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51083d88-8899-47a4-bb4a-a935569e2001 admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:45.212167 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51083d88-8899-47a4-bb4a-a935569e2001 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:45.212443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51083d88-8899-47a4-bb4a-a935569e2001 admin admin] PATH_INFO: `/v3/projects` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:45.213116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51083d88-8899-47a4-bb4a-a935569e2001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:45.215040 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51083d88-8899-47a4-bb4a-a935569e2001 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:45.238939 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1410/2778] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:37:45 2021] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:45.243345 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76064ce4-1bba-40de-b04b-dc5387f98e06 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:45.254365 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76064ce4-1bba-40de-b04b-dc5387f98e06 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:45.308385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a18119-d7d2-46a9-9af4-46dba97f1c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:45.308969 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a18119-d7d2-46a9-9af4-46dba97f1c24 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:45.309246 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a18119-d7d2-46a9-9af4-46dba97f1c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:45.309515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a18119-d7d2-46a9-9af4-46dba97f1c24 admin admin] PATH_INFO: `/v3/users` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:45.310208 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a18119-d7d2-46a9-9af4-46dba97f1c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:45.312174 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a18119-d7d2-46a9-9af4-46dba97f1c24 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:45.331360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1369/2779] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:37:45 2021] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:45.335236 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51083d88-8899-47a4-bb4a-a935569e2001 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:45.345584 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51083d88-8899-47a4-bb4a-a935569e2001 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:45.350236 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f0ab4-65d3-4158-9e48-adb7fdc00678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:45.350922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f0ab4-65d3-4158-9e48-adb7fdc00678 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:45.351204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f0ab4-65d3-4158-9e48-adb7fdc00678 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:45.351508 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f0ab4-65d3-4158-9e48-adb7fdc00678 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:45.352225 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f0ab4-65d3-4158-9e48-adb7fdc00678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:45.353793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f0ab4-65d3-4158-9e48-adb7fdc00678 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:45.364391 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1411/2780] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:45.368398 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a18119-d7d2-46a9-9af4-46dba97f1c24 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:45.378546 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a18119-d7d2-46a9-9af4-46dba97f1c24 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:45.383338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa9852-be47-4595-8588-009d01ed9800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:45.384192 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa9852-be47-4595-8588-009d01ed9800 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:45.384472 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa9852-be47-4595-8588-009d01ed9800 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:45.384749 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa9852-be47-4595-8588-009d01ed9800 admin admin] PATH_INFO: `/v3/projects/2c6ec2e5d4d746d2a6885c91266988a1/users/1838ee39288d44d7a63a9cd1b3104ba8/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:45.398602 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa9852-be47-4595-8588-009d01ed9800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6ec2e5d4d746d2a6885c91266988a1, user_id=1838ee39288d44d7a63a9cd1b3104ba8, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:45.401262 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa9852-be47-4595-8588-009d01ed9800 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:45.413697 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1370/2781] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:45 2021] PUT /identity/v3/projects/2c6ec2e5d4d746d2a6885c91266988a1/users/1838ee39288d44d7a63a9cd1b3104ba8/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:45.417523 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f0ab4-65d3-4158-9e48-adb7fdc00678 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:45.427668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f0ab4-65d3-4158-9e48-adb7fdc00678 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:45.480781 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceaa78-d94c-4d67-8ca1-145979174f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:45.481434 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceaa78-d94c-4d67-8ca1-145979174f16 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:45.481725 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceaa78-d94c-4d67-8ca1-145979174f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:45.482001 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceaa78-d94c-4d67-8ca1-145979174f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:45.482836 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceaa78-d94c-4d67-8ca1-145979174f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:45.484443 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceaa78-d94c-4d67-8ca1-145979174f16 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:45.494513 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1412/2782] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:45 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:45.498582 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa9852-be47-4595-8588-009d01ed9800 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:45.510232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa9852-be47-4595-8588-009d01ed9800 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:45.514833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef525d68-283c-4d3d-bc38-93dbb4be9ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:45.515707 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef525d68-283c-4d3d-bc38-93dbb4be9ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:45.516023 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef525d68-283c-4d3d-bc38-93dbb4be9ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:45.516302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef525d68-283c-4d3d-bc38-93dbb4be9ae0 admin admin] PATH_INFO: `/v3/projects/2c6ec2e5d4d746d2a6885c91266988a1/users/1838ee39288d44d7a63a9cd1b3104ba8/roles/2bd7b644c431434aad6e3453e58eb3af` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:45.518227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef525d68-283c-4d3d-bc38-93dbb4be9ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6ec2e5d4d746d2a6885c91266988a1, user_id=1838ee39288d44d7a63a9cd1b3104ba8, role_id=2bd7b644c431434aad6e3453e58eb3af)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:45.520898 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef525d68-283c-4d3d-bc38-93dbb4be9ae0 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:45.530746 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1371/2783] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:45 2021] PUT /identity/v3/projects/2c6ec2e5d4d746d2a6885c91266988a1/users/1838ee39288d44d7a63a9cd1b3104ba8/roles/2bd7b644c431434aad6e3453e58eb3af => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:45.541456 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913786b6-86d5-4bd1-a336-04a921bc1b49 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:45.541749 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913786b6-86d5-4bd1-a336-04a921bc1b49 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:45.542029 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913786b6-86d5-4bd1-a336-04a921bc1b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:45.568715 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-913786b6-86d5-4bd1-a336-04a921bc1b49 None None] MFA Rules not processed for user `1838ee39288d44d7a63a9cd1b3104ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:45.569876 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-913786b6-86d5-4bd1-a336-04a921bc1b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:45.633996 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1413/2784] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:45 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:45.643812 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef525d68-283c-4d3d-bc38-93dbb4be9ae0 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:45.645568 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-ef525d68-283c-4d3d-bc38-93dbb4be9ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:45.699166 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef525d68-283c-4d3d-bc38-93dbb4be9ae0 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:45.702751 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd841f9-a0f3-42d4-9a38-7373d634dd83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:45.703378 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd841f9-a0f3-42d4-9a38-7373d634dd83 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:45.703660 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd841f9-a0f3-42d4-9a38-7373d634dd83 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:45.703941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd841f9-a0f3-42d4-9a38-7373d634dd83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:45.712456 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd841f9-a0f3-42d4-9a38-7373d634dd83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:45.713856 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd841f9-a0f3-42d4-9a38-7373d634dd83 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:45.723562 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1372/2785] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:45 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:46.162837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913786b6-86d5-4bd1-a336-04a921bc1b49 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:46.164236 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-913786b6-86d5-4bd1-a336-04a921bc1b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:46.176000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913786b6-86d5-4bd1-a336-04a921bc1b49 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:46.179526 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f164ea-bb29-4e31-88a0-9d96ae4069b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:46.180158 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f164ea-bb29-4e31-88a0-9d96ae4069b1 service cinder] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:46.180439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f164ea-bb29-4e31-88a0-9d96ae4069b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:46.180713 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f164ea-bb29-4e31-88a0-9d96ae4069b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:46.233724 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f164ea-bb29-4e31-88a0-9d96ae4069b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:46.235249 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f164ea-bb29-4e31-88a0-9d96ae4069b1 service cinder] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:46.243782 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1414/2786] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:46 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:50.175490 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd841f9-a0f3-42d4-9a38-7373d634dd83 service cinder] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:50.184129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd841f9-a0f3-42d4-9a38-7373d634dd83 service cinder] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:50.188054 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f357-68bf-4f3a-afb6-8af6c55bfa77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:50.188689 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f357-68bf-4f3a-afb6-8af6c55bfa77 service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:50.188974 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f357-68bf-4f3a-afb6-8af6c55bfa77 service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:50.189249 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f357-68bf-4f3a-afb6-8af6c55bfa77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:50.242647 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341f357-68bf-4f3a-afb6-8af6c55bfa77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:50.244021 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341f357-68bf-4f3a-afb6-8af6c55bfa77 service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:50.252539 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1373/2787] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:50 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:52.226793 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f164ea-bb29-4e31-88a0-9d96ae4069b1 service cinder] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:52.287289 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f164ea-bb29-4e31-88a0-9d96ae4069b1 service cinder] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:52.291724 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:52.292568 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:52.292847 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:52.293116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] PATH_INFO: `/v3/users/2543d6320bee41fe846fa0deecbfc2fd` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:52.294261 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2543d6320bee41fe846fa0deecbfc2fd)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:52.296187 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:52.339186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2543d6320bee41fe846fa0deecbfc2fd'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:52.350593 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2543d6320bee41fe846fa0deecbfc2fd'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:52.351301 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2543d6320bee41fe846fa0deecbfc2fd'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:52.357948 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2543d6320bee41fe846fa0deecbfc2fd'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:52.358571 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2543d6320bee41fe846fa0deecbfc2fd'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:52.370452 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1415/2788] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:37:52 2021] DELETE /identity/v3/users/2543d6320bee41fe846fa0deecbfc2fd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:52.374966 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719ee5b-c226-4a1f-bff6-251bed496859 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:52.375952 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719ee5b-c226-4a1f-bff6-251bed496859 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:52.376071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719ee5b-c226-4a1f-bff6-251bed496859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:52.393053 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-1719ee5b-c226-4a1f-bff6-251bed496859 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:52.394211 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1719ee5b-c226-4a1f-bff6-251bed496859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:52.447453 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1374/2789] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:52.457518 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:52.459248 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:52.521488 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbcc13-39a1-4922-bd77-a78de83ce0f8 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:52.525144 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19b64-473e-4134-8806-409b373b387f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:52.525786 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19b64-473e-4134-8806-409b373b387f service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:52.526071 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19b64-473e-4134-8806-409b373b387f service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:52.526347 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d19b64-473e-4134-8806-409b373b387f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:52.535234 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d19b64-473e-4134-8806-409b373b387f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:52.536668 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d19b64-473e-4134-8806-409b373b387f service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:52.545861 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1416/2790] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:52.814070 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719ee5b-c226-4a1f-bff6-251bed496859 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:52.815373 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-1719ee5b-c226-4a1f-bff6-251bed496859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:52.828951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719ee5b-c226-4a1f-bff6-251bed496859 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:52.835333 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:52.836356 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:52.836640 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:52.836918 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] PATH_INFO: `/v3/projects/50880780dedb4657ad78446d60cbd3ed` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:52.838127 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50880780dedb4657ad78446d60cbd3ed)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:52.840350 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:52.858261 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19b64-473e-4134-8806-409b373b387f service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:52.860466 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a7d19b64-473e-4134-8806-409b373b387f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:52.928779 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50880780dedb4657ad78446d60cbd3ed', 'request_id': 'req-9961faaa-61e1-4c1f-9c0c-3babc04de070'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:52.935302 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50880780dedb4657ad78446d60cbd3ed', 'request_id': 'req-9961faaa-61e1-4c1f-9c0c-3babc04de070'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:52.942818 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50880780dedb4657ad78446d60cbd3ed', 'request_id': 'req-9961faaa-61e1-4c1f-9c0c-3babc04de070'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:52.958993 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d19b64-473e-4134-8806-409b373b387f service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:52.963340 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] The token cache is being invalidate because project 50880780dedb4657ad78446d60cbd3ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:37:52.963631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:52.964270 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:52.965789 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1375/2791] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:37:52 2021] DELETE /identity/v3/projects/50880780dedb4657ad78446d60cbd3ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:52.969587 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:52.970953 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:53.020756 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555ed5f-04d0-4e38-a09d-19b69f21f7d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:53.021450 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ed5f-04d0-4e38-a09d-19b69f21f7d4 service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:53.021686 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ed5f-04d0-4e38-a09d-19b69f21f7d4 service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:53.021964 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ed5f-04d0-4e38-a09d-19b69f21f7d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:53.023728 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e555ed5f-04d0-4e38-a09d-19b69f21f7d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:53.031657 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961faaa-61e1-4c1f-9c0c-3babc04de070 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:53.035532 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555ed5f-04d0-4e38-a09d-19b69f21f7d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:53.036327 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:53.037101 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555ed5f-04d0-4e38-a09d-19b69f21f7d4 service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:53.037238 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:53.037486 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:53.037757 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] PATH_INFO: `/v3/users/8274ee94ad2f4449b978fbf7e6c15d3e` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:53.038966 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8274ee94ad2f4449b978fbf7e6c15d3e)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:53.040869 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:53.047944 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1417/2792] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 01:37:53.087770 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8274ee94ad2f4449b978fbf7e6c15d3e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.095205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8274ee94ad2f4449b978fbf7e6c15d3e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.095990 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8274ee94ad2f4449b978fbf7e6c15d3e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.096667 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8274ee94ad2f4449b978fbf7e6c15d3e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.105393 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8274ee94ad2f4449b978fbf7e6c15d3e'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.122695 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1376/2793] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:37:52 2021] DELETE /identity/v3/users/8274ee94ad2f4449b978fbf7e6c15d3e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:53.258511 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555ed5f-04d0-4e38-a09d-19b69f21f7d4 service nova] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:53.260036 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-e555ed5f-04d0-4e38-a09d-19b69f21f7d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:53.318571 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555ed5f-04d0-4e38-a09d-19b69f21f7d4 service nova] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:53.365112 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2227fc1-e193-40d0-855a-324c933e78b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:53.366088 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227fc1-e193-40d0-855a-324c933e78b9 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:53.366367 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227fc1-e193-40d0-855a-324c933e78b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:53.366638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227fc1-e193-40d0-855a-324c933e78b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:53.368425 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a2227fc1-e193-40d0-855a-324c933e78b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:53.377853 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2227fc1-e193-40d0-855a-324c933e78b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:53.379343 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2227fc1-e193-40d0-855a-324c933e78b9 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:53.388054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1418/2794] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:53 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:53.391245 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:53.392771 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:53.459807 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0cad8-c04a-49d6-8986-fb205d35cc15 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:53.464725 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:53.465616 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:53.465903 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:53.466180 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] PATH_INFO: `/v3/projects/d9cd7bd550a1440faaed5b0dabf1671c` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:53.467367 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9cd7bd550a1440faaed5b0dabf1671c)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:53.469896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:53.514162 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9cd7bd550a1440faaed5b0dabf1671c', 'request_id': 'req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.520806 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9cd7bd550a1440faaed5b0dabf1671c', 'request_id': 'req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.526140 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9cd7bd550a1440faaed5b0dabf1671c', 'request_id': 'req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.538696 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] The token cache is being invalidate because project d9cd7bd550a1440faaed5b0dabf1671c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:37:53.539014 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.539628 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.541135 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1377/2795] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:37:53 2021] DELETE /identity/v3/projects/d9cd7bd550a1440faaed5b0dabf1671c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:53.545131 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2227fc1-e193-40d0-855a-324c933e78b9 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:53.556096 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2227fc1-e193-40d0-855a-324c933e78b9 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:53.609169 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:53.610019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:53.610302 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:53.610576 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] PATH_INFO: `/v3/users/1838ee39288d44d7a63a9cd1b3104ba8` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:53.611770 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1838ee39288d44d7a63a9cd1b3104ba8)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:53.613673 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:53.656028 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1838ee39288d44d7a63a9cd1b3104ba8'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.667843 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1838ee39288d44d7a63a9cd1b3104ba8'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.668551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1838ee39288d44d7a63a9cd1b3104ba8'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.675638 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1838ee39288d44d7a63a9cd1b3104ba8'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.676272 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-b533b24b-6425-4932-9a5d-c81b869f9ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1838ee39288d44d7a63a9cd1b3104ba8'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:53.689605 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1419/2796] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:37:53 2021] DELETE /identity/v3/users/1838ee39288d44d7a63a9cd1b3104ba8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:37:53.951241 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:53.952927 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:53.974386 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770d5f-f9e6-4723-bcf6-fa6611c2d4fe admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:54.030747 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:54.032113 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.032396 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.032694 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] PATH_INFO: `/v3/projects/2c6ec2e5d4d746d2a6885c91266988a1` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.033876 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6ec2e5d4d746d2a6885c91266988a1)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:54.035932 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:54.081082 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6ec2e5d4d746d2a6885c91266988a1', 'request_id': 'req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:54.087122 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6ec2e5d4d746d2a6885c91266988a1', 'request_id': 'req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:54.092444 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6ec2e5d4d746d2a6885c91266988a1', 'request_id': 'req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:54.105606 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] The token cache is being invalidate because project 2c6ec2e5d4d746d2a6885c91266988a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:37:54.106043 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:54.106671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-2ab54a3a-31ce-45ea-bbd5-fdd8cfa066aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:54.108229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1378/2797] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:37:53 2021] DELETE /identity/v3/projects/2c6ec2e5d4d746d2a6885c91266988a1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:54.115596 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659329cf-0bde-424d-a5dc-54407b3f18e9 None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.115898 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659329cf-0bde-424d-a5dc-54407b3f18e9 None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.116179 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659329cf-0bde-424d-a5dc-54407b3f18e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.134954 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-659329cf-0bde-424d-a5dc-54407b3f18e9 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:54.136141 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-659329cf-0bde-424d-a5dc-54407b3f18e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:54.192279 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1420/2798] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 01:37:54.200811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9d51-20a2-4001-bd70-36c7c8886f54 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.201111 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9d51-20a2-4001-bd70-36c7c8886f54 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.201510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9d51-20a2-4001-bd70-36c7c8886f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.221382 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-514c9d51-20a2-4001-bd70-36c7c8886f54 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:54.222581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-514c9d51-20a2-4001-bd70-36c7c8886f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:54.230566 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1379/2799] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:54.235227 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659329cf-0bde-424d-a5dc-54407b3f18e9 None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:54.244632 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659329cf-0bde-424d-a5dc-54407b3f18e9 None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:54.249401 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d9dd1-050c-460e-8986-594b6fd58af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:54.250701 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d9dd1-050c-460e-8986-594b6fd58af0 admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.250983 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d9dd1-050c-460e-8986-594b6fd58af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.251262 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d9dd1-050c-460e-8986-594b6fd58af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.252012 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d9dd1-050c-460e-8986-594b6fd58af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 01:37:54.252322 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d9dd1-050c-460e-8986-594b6fd58af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:54.253918 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d9dd1-050c-460e-8986-594b6fd58af0 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:54.265621 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1421/2800] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Aug 25 01:37:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 01:37:54.269390 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9d51-20a2-4001-bd70-36c7c8886f54 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:54.278230 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9d51-20a2-4001-bd70-36c7c8886f54 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:54.282882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a350cb1-1567-4420-8c5e-06707dc56e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:54.283515 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a350cb1-1567-4420-8c5e-06707dc56e57 admin admin] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.283799 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a350cb1-1567-4420-8c5e-06707dc56e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.284078 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a350cb1-1567-4420-8c5e-06707dc56e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.284759 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a350cb1-1567-4420-8c5e-06707dc56e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:54.286626 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a350cb1-1567-4420-8c5e-06707dc56e57 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:54.311110 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1380/2801] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Aug 25 01:37:54 2021] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 01:37:54.315522 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d9dd1-050c-460e-8986-594b6fd58af0 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:54.325359 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d9dd1-050c-460e-8986-594b6fd58af0 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:54.383255 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8464c01-41d5-425b-95d0-b79ec28c739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:54.383930 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8464c01-41d5-425b-95d0-b79ec28c739b admin admin] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.384216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8464c01-41d5-425b-95d0-b79ec28c739b admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.384499 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8464c01-41d5-425b-95d0-b79ec28c739b admin admin] PATH_INFO: `/v3/users` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.385190 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8464c01-41d5-425b-95d0-b79ec28c739b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:54.387140 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8464c01-41d5-425b-95d0-b79ec28c739b admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:54.413935 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1422/2802] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Aug 25 01:37:54 2021] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 01:37:54.415339 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a350cb1-1567-4420-8c5e-06707dc56e57 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:54.427318 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a350cb1-1567-4420-8c5e-06707dc56e57 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:54.432264 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869bcc5-c4a0-4f7e-88f0-ee1d68670c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:54.432920 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869bcc5-c4a0-4f7e-88f0-ee1d68670c09 admin admin] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.433199 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869bcc5-c4a0-4f7e-88f0-ee1d68670c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.433516 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869bcc5-c4a0-4f7e-88f0-ee1d68670c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.434254 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869bcc5-c4a0-4f7e-88f0-ee1d68670c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:54.435969 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869bcc5-c4a0-4f7e-88f0-ee1d68670c09 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:54.447305 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1381/2803] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:54.451461 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8464c01-41d5-425b-95d0-b79ec28c739b admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:54.461551 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8464c01-41d5-425b-95d0-b79ec28c739b admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:54.466171 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933dc80-42fa-4899-818d-68726b45058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:54.466870 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933dc80-42fa-4899-818d-68726b45058f admin admin] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.467151 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933dc80-42fa-4899-818d-68726b45058f admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.467427 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933dc80-42fa-4899-818d-68726b45058f admin admin] PATH_INFO: `/v3/roles` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.468162 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933dc80-42fa-4899-818d-68726b45058f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:54.469764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933dc80-42fa-4899-818d-68726b45058f admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:54.480216 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1423/2804] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Aug 25 01:37:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 01:37:54.484947 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869bcc5-c4a0-4f7e-88f0-ee1d68670c09 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:54.494797 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869bcc5-c4a0-4f7e-88f0-ee1d68670c09 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:54.499414 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3219d8-df13-4c62-bc9a-45194732db0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:54.500951 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3219d8-df13-4c62-bc9a-45194732db0a admin admin] REQUEST_METHOD: `PUT` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.501232 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3219d8-df13-4c62-bc9a-45194732db0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.501510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3219d8-df13-4c62-bc9a-45194732db0a admin admin] PATH_INFO: `/v3/projects/fbac09fa63a740219d583750b8620a44/users/3fc139396b2e4a3d9384be3aea1b0764/roles/426e730bef7e42f4bb8753fa9312a9c2` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.515822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3219d8-df13-4c62-bc9a-45194732db0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbac09fa63a740219d583750b8620a44, user_id=3fc139396b2e4a3d9384be3aea1b0764, role_id=426e730bef7e42f4bb8753fa9312a9c2)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:54.518443 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3219d8-df13-4c62-bc9a-45194732db0a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:54.531257 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1382/2805] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Aug 25 01:37:54 2021] PUT /identity/v3/projects/fbac09fa63a740219d583750b8620a44/users/3fc139396b2e4a3d9384be3aea1b0764/roles/426e730bef7e42f4bb8753fa9312a9c2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:54.542966 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c7ee-4b5d-4fd9-9a6c-e830f1ebbb6a None None] REQUEST_METHOD: `POST` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.543254 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c7ee-4b5d-4fd9-9a6c-e830f1ebbb6a None None] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.543537 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c7ee-4b5d-4fd9-9a6c-e830f1ebbb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.570888 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.auth.core [None req-a5d6c7ee-4b5d-4fd9-9a6c-e830f1ebbb6a None None] MFA Rules not processed for user `3fc139396b2e4a3d9384be3aea1b0764`. Rule list: `[]` (Enabled: `True`). {{(pid=73335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:54.572016 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-a5d6c7ee-4b5d-4fd9-9a6c-e830f1ebbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:54.633379 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1424/2806] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:54 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:54.643801 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3219d8-df13-4c62-bc9a-45194732db0a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:54.645467 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-be3219d8-df13-4c62-bc9a-45194732db0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:54.699896 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3219d8-df13-4c62-bc9a-45194732db0a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:54.703581 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882a3fa-2a57-4a7b-b94e-575d4c82b68d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dde8359945b45bbbf5d3a27964a7f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:54.704213 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a3fa-2a57-4a7b-b94e-575d4c82b68d service cinder] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:54.704498 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a3fa-2a57-4a7b-b94e-575d4c82b68d service cinder] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:54.704777 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a3fa-2a57-4a7b-b94e-575d4c82b68d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:54.712811 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882a3fa-2a57-4a7b-b94e-575d4c82b68d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:54.714225 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882a3fa-2a57-4a7b-b94e-575d4c82b68d service cinder] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:54.723385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1383/2807] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:54 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:57.242505 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6c7ee-4b5d-4fd9-9a6c-e830f1ebbb6a None None] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:57.344951 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6c7ee-4b5d-4fd9-9a6c-e830f1ebbb6a None None] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:57.364447 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:57.365894 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:57.366509 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:57.367000 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] PATH_INFO: `/v3/users/3fc139396b2e4a3d9384be3aea1b0764` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:57.368439 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc139396b2e4a3d9384be3aea1b0764)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:57.370594 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:57.440045 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc139396b2e4a3d9384be3aea1b0764'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:57.456487 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc139396b2e4a3d9384be3aea1b0764'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:57.457361 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc139396b2e4a3d9384be3aea1b0764'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:57.467581 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc139396b2e4a3d9384be3aea1b0764'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:57.468491 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc139396b2e4a3d9384be3aea1b0764'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:57.492285 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1425/2808] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:37:57 2021] DELETE /identity/v3/users/3fc139396b2e4a3d9384be3aea1b0764 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:37:57.494385 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654746-1474-46f3-a06a-d28ee3166953 None None] REQUEST_METHOD: `POST` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:57.494892 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654746-1474-46f3-a06a-d28ee3166953 None None] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:57.495006 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654746-1474-46f3-a06a-d28ee3166953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:57.523864 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.auth.core [None req-12654746-1474-46f3-a06a-d28ee3166953 None None] MFA Rules not processed for user `3c48fa6914a840d99c4665f7fb9f25b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 01:37:57.525551 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-12654746-1474-46f3-a06a-d28ee3166953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:57.596992 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1384/2809] 10.222.0.23 () {58 vars in 958 bytes} [Wed Aug 25 01:37:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 01:37:57.604021 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:57.605942 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:57.683524 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2badc-7924-4cbe-a1c6-774a11f68b0d admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:57.687825 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1e538-ae57-4f7f-be11-d9e2e61b2411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:57.688573 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1e538-ae57-4f7f-be11-d9e2e61b2411 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:57.688922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1e538-ae57-4f7f-be11-d9e2e61b2411 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:57.689264 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1e538-ae57-4f7f-be11-d9e2e61b2411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:57.699081 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1e538-ae57-4f7f-be11-d9e2e61b2411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:57.700787 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1e538-ae57-4f7f-be11-d9e2e61b2411 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:57.711172 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1426/2810] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:37:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:37:58.011934 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12654746-1474-46f3-a06a-d28ee3166953 None None] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:37:58.013387 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-12654746-1474-46f3-a06a-d28ee3166953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:37:58.025510 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12654746-1474-46f3-a06a-d28ee3166953 None None] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:37:58.030163 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:37:58.031341 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:37:58.031485 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:37:58.031659 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] PATH_INFO: `/v3/projects/fbac09fa63a740219d583750b8620a44` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:37:58.033338 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbac09fa63a740219d583750b8620a44)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:37:58.035729 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:37:58.091375 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbac09fa63a740219d583750b8620a44', 'request_id': 'req-d53e053e-f8c6-4cea-8bca-930161c017c8'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:58.097422 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbac09fa63a740219d583750b8620a44', 'request_id': 'req-d53e053e-f8c6-4cea-8bca-930161c017c8'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:58.102882 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbac09fa63a740219d583750b8620a44', 'request_id': 'req-d53e053e-f8c6-4cea-8bca-930161c017c8'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:58.115847 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] The token cache is being invalidate because project fbac09fa63a740219d583750b8620a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:37:58.116148 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:58.116822 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:37:58.118372 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1385/2811] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:37:58 2021] DELETE /identity/v3/projects/fbac09fa63a740219d583750b8620a44 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:39:26.368577 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1e538-ae57-4f7f-be11-d9e2e61b2411 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:39:26.370654 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-4ca1e538-ae57-4f7f-be11-d9e2e61b2411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:39:26.446195 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1e538-ae57-4f7f-be11-d9e2e61b2411 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:39:26.520064 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd0f8-5bed-40a6-8d5f-d0e967d133df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:39:26.520741 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd0f8-5bed-40a6-8d5f-d0e967d133df service nova] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:39:26.521019 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd0f8-5bed-40a6-8d5f-d0e967d133df service nova] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:39:26.521296 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd0f8-5bed-40a6-8d5f-d0e967d133df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:39:26.523222 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-90ecd0f8-5bed-40a6-8d5f-d0e967d133df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:39:26.536332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd0f8-5bed-40a6-8d5f-d0e967d133df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:39:26.538009 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd0f8-5bed-40a6-8d5f-d0e967d133df service nova] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:39:26.549199 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1427/2812] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:39:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:39:28.557133 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:39:28.558671 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:39:28.575273 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e053e-f8c6-4cea-8bca-930161c017c8 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:39:28.581360 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0d4b-d83c-40c5-9250-0ce4378f5d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd061cf5060334e79ab4f22518d37116f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:39:28.581999 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0d4b-d83c-40c5-9250-0ce4378f5d31 service nova] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:39:28.582282 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0d4b-d83c-40c5-9250-0ce4378f5d31 service nova] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:39:28.582556 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b0d4b-d83c-40c5-9250-0ce4378f5d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:39:28.584563 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b85b0d4b-d83c-40c5-9250-0ce4378f5d31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:39:28.597071 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b0d4b-d83c-40c5-9250-0ce4378f5d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:39:28.598649 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b0d4b-d83c-40c5-9250-0ce4378f5d31 service nova] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:39:28.609117 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1386/2813] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:39:28 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:39:38.717772 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd0f8-5bed-40a6-8d5f-d0e967d133df service nova] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:39:38.719998 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-90ecd0f8-5bed-40a6-8d5f-d0e967d133df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:39:38.773463 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd0f8-5bed-40a6-8d5f-d0e967d133df service nova] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:39:38.776922 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae2fa-9b6d-4c47-920a-a0879bd502e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a08ace1a65c040bf97108a1660f962ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:39:38.777557 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae2fa-9b6d-4c47-920a-a0879bd502e3 service neutron] REQUEST_METHOD: `GET` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:39:38.777840 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae2fa-9b6d-4c47-920a-a0879bd502e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:39:38.778114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae2fa-9b6d-4c47-920a-a0879bd502e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:39:38.780204 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-fe4ae2fa-9b6d-4c47-920a-a0879bd502e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:39:38.840462 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ae2fa-9b6d-4c47-920a-a0879bd502e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:39:38.841895 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ae2fa-9b6d-4c47-920a-a0879bd502e3 service neutron] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:39:38.851252 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1428/2814] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:39:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 01:39:44.964604 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0d4b-d83c-40c5-9250-0ce4378f5d31 service nova] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:39:44.966117 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-b85b0d4b-d83c-40c5-9250-0ce4378f5d31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:39:44.979631 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b0d4b-d83c-40c5-9250-0ce4378f5d31 service nova] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:39:44.984094 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:39:44.984943 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:39:44.985227 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:39:44.985502 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] PATH_INFO: `/v3/users/2fba46fcf5a742d28b39d9fef9c91df5` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:39:44.986664 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fba46fcf5a742d28b39d9fef9c91df5)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:39:44.988592 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:39:45.033676 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fba46fcf5a742d28b39d9fef9c91df5'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.040229 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fba46fcf5a742d28b39d9fef9c91df5'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.040833 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fba46fcf5a742d28b39d9fef9c91df5'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.041430 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fba46fcf5a742d28b39d9fef9c91df5'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.048500 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fba46fcf5a742d28b39d9fef9c91df5'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.065941 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1387/2815] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:39:44 2021] DELETE /identity/v3/users/2fba46fcf5a742d28b39d9fef9c91df5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:39:45.231837 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae2fa-9b6d-4c47-920a-a0879bd502e3 service neutron] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:39:45.242116 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae2fa-9b6d-4c47-920a-a0879bd502e3 service neutron] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:39:45.298669 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:39:45.299484 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:39:45.299764 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:39:45.300037 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] PATH_INFO: `/v3/projects/ada43be06e92474191038a2b41a9f39b` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:39:45.301186 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada43be06e92474191038a2b41a9f39b)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:39:45.303114 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:39:45.345769 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada43be06e92474191038a2b41a9f39b', 'request_id': 'req-91ea991c-503b-416d-b427-b161e3ad66f3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.351470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada43be06e92474191038a2b41a9f39b', 'request_id': 'req-91ea991c-503b-416d-b427-b161e3ad66f3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.357137 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada43be06e92474191038a2b41a9f39b', 'request_id': 'req-91ea991c-503b-416d-b427-b161e3ad66f3'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.368675 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] The token cache is being invalidate because project ada43be06e92474191038a2b41a9f39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:39:45.368963 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.369569 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.371080 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1429/2816] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:39:45 2021] DELETE /identity/v3/projects/ada43be06e92474191038a2b41a9f39b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 01:39:45.375093 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:39:45.377129 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:39:45.390039 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9334a3c-d3ac-434d-bbcf-f98969723825 admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:39:45.443178 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:39:45.444031 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:39:45.444316 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:39:45.444593 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] PATH_INFO: `/v3/users/e21f4e15a74c4b338094b3e423a91ae0` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:39:45.445761 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21f4e15a74c4b338094b3e423a91ae0)` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:39:45.447708 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:39:45.489460 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21f4e15a74c4b338094b3e423a91ae0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.496027 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21f4e15a74c4b338094b3e423a91ae0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.496678 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21f4e15a74c4b338094b3e423a91ae0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.497279 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21f4e15a74c4b338094b3e423a91ae0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.504630 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.notifications [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21f4e15a74c4b338094b3e423a91ae0'} {{(pid=73336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.521558 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1388/2817] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Aug 25 01:39:45 2021] DELETE /identity/v3/users/e21f4e15a74c4b338094b3e423a91ae0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:39:45.685312 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] Authenticating user token {{(pid=73335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:39:45.687054 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.fernet_utils [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:39:45.701746 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea991c-503b-416d-b427-b161e3ad66f3 admin admin] Validating token access rules against request {{(pid=73335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:39:45.757470 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c48fa6914a840d99c4665f7fb9f25b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '220c843aa1514b7390df45e1ecd50d12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:39:45.758332 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:39:45.758613 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] SCRIPT_NAME: `/identity` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:39:45.759208 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] PATH_INFO: `/v3/projects/0c2d14a240674ff392a60602ca5b849a` {{(pid=73335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:39:45.760355 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2d14a240674ff392a60602ca5b849a)` {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:39:45.762284 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] RBAC: Authorization granted {{(pid=73335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:39:45.807536 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2d14a240674ff392a60602ca5b849a', 'request_id': 'req-0dd40af0-02d6-40c4-b7d4-9e69388c797a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.813405 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2d14a240674ff392a60602ca5b849a', 'request_id': 'req-0dd40af0-02d6-40c4-b7d4-9e69388c797a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.818788 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2d14a240674ff392a60602ca5b849a', 'request_id': 'req-0dd40af0-02d6-40c4-b7d4-9e69388c797a'} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.830092 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] The token cache is being invalidate because project 0c2d14a240674ff392a60602ca5b849a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 01:39:45.830383 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.831027 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: DEBUG keystone.notifications [None req-0dd40af0-02d6-40c4-b7d4-9e69388c797a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 01:39:45.832507 dv-cinder-790014-2-iscsi devstack@keystone.service[73335]: [pid: 73335|app: 0|req: 1430/2818] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Aug 25 01:39:45 2021] DELETE /identity/v3/projects/0c2d14a240674ff392a60602ca5b849a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 01:40:30.639195 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] Authenticating user token {{(pid=73336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 01:40:30.640584 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:40:30.774029 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda3c42-0674-4991-9e38-61d83ed0083a admin admin] Validating token access rules against request {{(pid=73336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 01:40:30.830239 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435672ab-9276-4b9e-a1ce-639ff1570c75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b49222a8e4474bbe14019418ec8aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c05a7beb6b04d15994db7ac0c7b98a2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 01:40:30.830916 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435672ab-9276-4b9e-a1ce-639ff1570c75 service placement] REQUEST_METHOD: `GET` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 01:40:30.831205 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435672ab-9276-4b9e-a1ce-639ff1570c75 service placement] SCRIPT_NAME: `/identity` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 01:40:30.832069 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435672ab-9276-4b9e-a1ce-639ff1570c75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 01:40:30.833820 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.fernet_utils [None req-435672ab-9276-4b9e-a1ce-639ff1570c75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 01:40:30.844665 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435672ab-9276-4b9e-a1ce-639ff1570c75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 01:40:30.846219 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435672ab-9276-4b9e-a1ce-639ff1570c75 service placement] RBAC: Authorization granted {{(pid=73336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 01:40:30.855778 dv-cinder-790014-2-iscsi devstack@keystone.service[73336]: [pid: 73336|app: 0|req: 1389/2819] 10.222.0.23 () {60 vars in 1366 bytes} [Wed Aug 25 01:40:30 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)